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ABSTRACT 



— ~ " — One 7 "*) f ~t h e~~la r ge str~i nve s t i ga t i on s-of - eleme n t a r y 

education ever undertaken, the Sustaining Effects Study sought 
answers to a series of policy questions. The two major issues 
addressed by the study were (1) Who receives compensatory education 
(CE)? and (2) How effective is CE? Related to these primary issues 
were a number of secondary questions: (3) What is CE? (4) What is the 
nature of the process of classroom instruction in elementary 
education? (5) What happens to the achievement of students when their 
CE services are discontinued? (6) Is there an optimal duration and 
period for receipt of CE services? (7) What happens to student 
achievement over the summer, and is summer school effective? (8) What 
is the nature of the home environment of elementary school students? 
and (9) What are the relative contributions of > socioeconomic 
background and schooling toward school achievement? To obtain answers 
to these questions, a large amount of data was gathered through a 
complex design. Five substudies were initially planned: a 
longitudinal study assessing educational achievement for 3 
consecutive years; a study of successful i nstruct ional practices in 
high-poverty schools; a study of part icipant characteristics and 
relationships among economic status, educational need, and 
instructional services received; a cost-effectiveness study focusing 
on resources and services to which students were exposed during 
reading and math instruction; and a study of the effectiveness of 
summer school programs. A sixth substudy was added later and involved 
following a limited sample of students into their high school years. 
Numerous instruments were used to gather data from students and 
teachers. (Specific study designs, variables investigated, and 
results obtained are discussed.) (RH) 
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PREFACE 



The Sustaining Effects Study is one of the largest studies of elementary 
education ever under-taken. The general design of the study was detailed in 
the Request for Proposal issued by the U.S. Office of Education in the spring 
c! 1975, Dr. George Mayeske was the author of that document and was the 
originator of the ideas expressed in it. After the study was started, 
Dr. Mayeske was intimately involved in the implementation of the overall design 
Much of the credit for whatever success this study has is due to his basic 
.ideas. In addition, Dr. Mayeske devoted himself to giving the study superb 
administrative support. Within the Office, and later the Department of 
Education he secured financial support, expedited forms clearance, arranged 
meetings with Title I staff members, and contacted chief state school officers 
to arrange for their cooperation in securing the consent of local schools to 
participate in the study. In short, he was everything one could want in a ■ 
Project Officer. Prom the beginning, Dr. Janice Anderson was associated with 
the study as Associate Project Officer. When Dr. Mayeske transferred out of 
the Department of Education, she became the Project Officer and carried on in 
the same fine manner as Dr. .Mayeske had during the first five years of the 
study. She continued to support the project in an exemplary fashion with good 
budget support and excellent critical reviews of the first drafts of all the 
technical reports. These two dedicated government project officers deserve the 
sincere thanks of both the educational research community and our project staff 
for their dedication to this project and educational research in general. 

We were most pleased with the willingness o£ so many schools to work with as 
for three full years w When initially approached, about participating, a sur- 
prisingly large number of schools agreed to be part of the study. They 
committed themselves /to having a fall arid a spring test administration, to 
supplying us with data on the instruction received by each individual student 
in the school, and to supplying information on the staff. With very few 
exceptions, the schools remained with the study for as' long as they were needed 



and cooperated willingly in a demanding research schedule. We express our 
great appreciation to them for their participation. 

Finally, I would like to thank the staff and the advisory committees that were 
so essential to completing the work. They are listed on pa-as :cvii and xix 
All of our advisors were very helpful and made material ccr.~ributions * to the 
improvement of the design and conduct of the study. Scae of- them stayed with 
the study for eight years I They deserve our real thanks. The senior staff 
also stayed with the project as long as they were needed. As the Project 
Director from 1975 to 1931 ,■ I can attest to their devotion and har> r I work in 
making the study a success. I hope that when all the technical reports are 
examined and this final report is studied and evaluated, there will be some 
consensus that this cooperation and ,ef fO-rt_ha_ve_ made ^ lasting contribution 
to our understanding of elementary education. 



Launor ?. Carter 
January 198 3 
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CHAPTER I. AN INTERPRETIVE SUMMARY OF THE RESULTS OF THE 
SUSTAINING EFFECTS STUDY 

AN OVERVIEW OF THE REPORT 

The purpose of this report is to present an integrative summary of the results 
of the Sustaining Effects Study (SES). A short summary of the questions asked, 
and the findings follows : 

'1 . What Is Compensatory Education ? 

This question cannot be answered simply. Compensatory Education (CE) is 
an amalgam of many different services delivered in different ways. How- 
ever, it is clear that CE students receive services that are to some extent 
different from those they would have received had they not been selected 
for CE services. CE students, relative to regular students, receive more 
hours of instruction in reading and math. The instruction is in smaller 
classes; more of it is in small group settings, and more of it is given 
by special teachers and aides- The instruction is more varied, involves 
different content and methods of instruction , and more materials., and 
equipment are used. The typical mode of CE instruction is in a pull-out 
setting. The pull-out setting s seems to offer a positive learning environ- 
ment and rates very favorably when compared to other instructional settings 
Although CS students receive significantly more expensive instruction, and 
although they receive much more basic reading and math services, while 
they receive their compensatory instruction, they lose out on some of the 
instruction that regular students receive. 

2. Who Receives Compensatory Education? 

It is clear, in- terms of percentages, that poor children and educationally 
needy children are the principal recipients of Title I and other CE 
services. However, there are more non-poor than, poor children, and more 
children achieving above an .educational cut-off point (such as performing 



r " 1 23 



4 

one year below grade level) than there are children below such a 
level . The absolute nuraber of children receiving CZ who are non-ccor 
and achieving higher than one year below grade level is greater than 
the nuraber of children receiving CS services who fall below these cut- 
offs. Thus, while the trends are in the intended direction, it appears 
that there could be a better operation of the selection process to 
assure that more poor children, and more educationally needy children 
receive CS services . Possible improvements partially depend on a 
clarification of the intent of Congress regarding who should he served. 

3 . How Effective Is Compensatory Education ? 

Based on the results of data from the first year of data collection 
and from analyzing three-year longitudinal data, it appears that CZ , 
and particularly Title I, is effective in improving the- reading 
achievement of students in the first, second, and third grades. It 
is effective in improving the math performance of students in all ele- 
mentary grades. The amount of improvement relative to similar students 
who have not had CE services is not large, but it is statistically 
significant. The results of the three-year longitudinal study confirm 
the results for the first year. A number of different analyses show 
that many of the less disadvantaged Title I students benefited from a 
year of Title I services and who 'promoted out 1 . However, the most 
severely disadvantaged students usually received Title I services during 
all three years of the study and- did not show gains relative to similar 
students who did not have Title I. 

4. What Happens to the Achievement: of Students 'Then Their CZ Services Are 
Discontinued? 

j 

There is considerable turnover among students receiving CE. About* 40 ' 
percent of the students receiving Title I services in a given school 
year will not be receiving them the ensuing year. The figure is even 
higher for other forms of CE. The data show that' students who have 
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had their CS services discontinued do, in fact, receive services 
similar to regular students. Discontinuation of CE services does 
not seem to have .a deleterious ' effect. Students who lose their CE 
s - rvices because ^ey achieved at a level thac 'promoted then out' of 
'CS continue to perform at their relatively higher level. 

5 - What Happens to Student Achievement Over the Summer/ SflTd Is Summer 
School Effective ? 

Generally all groups of students continue educational growth over the 
summer. This growth is greater in reading than in math. There 
appears to be a slightly greater summer growth for regular students 
than for CS students in reading but not in math. This difference is 
judged to be practically insignificant. In comparing students who 
attended summer school with students who did not attend summer school, 
no increased achievement was evident. It is emphasized that the" 
amount of instruction in reading and math in the typical summer school 
is quite small and it is probably unrealistic to expect much academic 
growth. • 9 



6 • What Classroom Practices Influence Learning ? 

The many factors influencing classroom instruction were examined. A 
model of the elementary education process was developed. The model — 
included the interrelationships between school achievement gain and 
student's economic background, opportunity to learn, instructional 
practices, resources available, staff characteristics, coordination 
of instruction, and principal's instructional leadership. The model 
was fitted to the data obtained from interviewing principals and 
teachers, and from observations in the classroom. The best fitting 
model showed the process of elementary. education to be surprisingly 
complex and not dependent on any simple or straight-forward relation- 
7 ships . 
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7 . What- is the Ma ture of the Heme Environment of Elementary School 
Children? 

7*- •■: * 

The usual home of an elementary school child is a two-adult family home, 
with parents ■ about 35 years old; they are white, living in a single- 
family dwelling and have graduated from high-school. However, there 
* are from 20 to 35 percent who cdJme from homes with different charac - 
5^ teristics. The usual child spends about two hours during the day 

playing, about one hour doing chores, about two hours watching TV, an 
hour reading for pleasure, and an hour doing homework. Almost all 
parents expect heir children to graduate from high-school, and about 
25 t percent -ex" ct them t§ graduate from college. Over 75 percent of 
the parents e the quality of their children's schools as excellent 
or good- Whc . e home environment of Title I students is compared to 
that of regular ^cudeiits, the two home environments are quite similar, 
although there is a slight tendency for Title I -children to come from 
less advantaged homes. 

& • • 

8 . What is the Relative Contribution of Backcround and Schooling to the * 
Students' Academic Achievement ? r * 

Based on data collected from heme interviews, from the schools, and 
from the students, it was possible to form indexes for student back- 
ground, school characteristics , and school learning experiences . In 
analyzing thes^fe relationships, it was found that while background 
characteristics were important" determinants of achievement, .the school 
learning experiences were also important, particularly in the early 
grades . 

These are the major results of the study. In the sections that follow these 
results are given in more detail and their implications aire discussed. The 
detailed results of the study have been reported in the series of technical 
reports listed at the end of Chapter II. Generally, the • technical reports do- 

not contain extensile interpretive or policy-oriented discussions. It is the 
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intention of this report to summarize the important highlights of the reports, 
to integrate them, and to draw policy implications. _ The drawing of policy 
implications is necessarily a somewhat speculative activity because, when 
dona by a technical contractor, it reflects a limited perspective and one 
largely based on research data. Questions of congruence with other program 
objectives, and political considerations are frequently not adequately 
reflected in a researcher's thinking.. While the interpretations offered here 
need to be viewed as reflecting a limited perspective, they do have the 
distinct advantage of being based on the analysis of factual data. ^ 

In this chapter a statement of the problem as studied in each of the sub- 
sequent chapters will be given; there will be a summary of the data available,, 
and then a discussion of the possible implications of that data. Each of the 
subsequent chapters contains a more detailed presentation, so written as to 
be of interest to policy makers, educators, and citizens seriously concerned 
about elementary education. Each of the chapters in this report is based on 
the relevant technical reports. 

HIGHLIGHTS OF CHAPTER II - INTRODUCTION 

This chapter begins with a short history of the Sustaining Effects Study (SES) , 
pointing out that it started in July 1975 and, after a year of planning and 
preparation, data collection was begun at 329 public elementary schools in 
the fall of 1976. Data were collected for three successive school years. 
Each f al l and spring all of the students in each school took achievement and 
attitude tests; their teachers indicated the amounts and kinds of instruction 
each child received in reading and math during the school year, and the 
teachers and Drincipals reported- cn their own training, characteristics, and 
methods of instruction. 

The data collected were designed to" help obtain answers to a series of policy 
questions. The two major issues were: * . . 



1) Who receives compensatory education? 

2) How effective is compensatory education? 

Related to these primary issue? were a number of secondary questions: 

3) What is compensatory education? 

a' 

4) What is the nature cf the process of classroom instruction in 
e lemen tary education ? 

5 ) What h appe ns to the achievement of students .when their CE services 

are discontinued? 

6) Is there an optimum duration and period for receipt, of CE services? 

7) What happens to student achievement over the summer and is summer 
school effective? 

8) What is the nature of the home environment of elementary school 
students? 

9) What are the relative contributions of socio-economic background 
and schooling to school achievement? 

The remainder of Chapter II discusses the design of the Sustaining Effects 

Study, the various samples used in the study, the test and survey ins truments 

used to collect data, . relations with the schools and how the data were 

collected, the 1 in-depth 1 _study of high-coverty. schools^- and the series- of 

technical reports. 1 It is believed ■ that data of high quality were collected 

cn a very large number of regular and CE students. The .resulting data base 

i 

constitutes the largest and most thoroughly integrated body of information 
about elementary education that has ever been collected. 

HIGHLIGHTS OF CHAPTER III - WHAT IS COMPENSATORS EDUCATION? 

CE cannot be defined or described simply. It is an amalgam of many different 
programs, practices, and services. Chapter III contains several descriptions 
of CE programs. These qualitative descriptions support, quantified material 
gathered from the schools by the use of survey questions completed by school 
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superintendents, principals, and teachers. From data collected in 1976-1977, 
we determined that for the SES schools the average amount spent on the educa- 
tion of regular elementary students was 51,189. For students receiving 
Title I services this basic amount was supplemented by about 5436. The exact 
additional amount is hard to determine because of the difficulty in deter-, 
mining precisely the number of students receiving Title I services, but the 
general magnitude of these figures is illustrative of the cost of the • 
additional services Title I students receive. This additional money buys a 
considerable mix of different services. The largest amount of Title I funds 
pays for additional regular teachers, special ~ teachers , aidesv and ~otrfe~r ; 
instructional personnel. Smaller, but significant, amounts go for adminis- 
trative services, training, planning, and evaluation. Also, Title I funds 
are used for instructional materials- and audiovisual equipment, as well as 
for building alterations. Students receive guidance, counseling/ health, and 
nutritional services from Title I funds. In Chapter III the relative costs 
of these services are given . - 

Knowing where the money goes is interesting, but. one wonders what actual 
impact it has on instruction. In terms of the number of hours of readirtfj and 
math instruction, Title I students receive more hours of instruction than 
regular students in the same schools. ..In reading, in the first two grades, 
there are only small differences, but as grade increases there are large 
differences. For example, by the sixth grade Title I students receive 6.6 
hours of reading instruction per week, while regular students receive 5.0, 
a supplement of 32 percent. Iii math there are significant differences, in all 
grades, with Title I students receiving about 5.7 hours of instruction per . 
week, while regular students receive about 4.'9 hours, a supplement of 29 
percent. These figures are reassuring insofar as they show that Title I 
students actually receive more instruction in- basic subjects, but there is 
another side to the picture. The length of the school day is usually the 
same for all students and while the Title I students are receiving additional 
reading and math instruction, the regular students are receiving other 
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instruction. For example, teachers report that. while Title I students are 
receiving additional reading instruction, the regular students are receiving 
instruction, in reading, math or other subjects; are engaged in individual 
instruction; or are engaged in student-selected activities. Thus, while 
Title I" students are getting more basic instruction, they are losing out on 
other instruction. Unless the number of school days is increased or the 
school day is extended for Title I students, this result is inevitable, and 
one can question if Title- I students are receiving a net benefit. 

Are there qualitative differences in the services delivered to Ti~Ie I 
students? In terms' of class size the data -show that Title I students are 
instructed in slightly smaller classes than regular students. The size of 
classes varies by grade, but for both Reading and math and- for all grades, 

the classes with Title I students are smaller than those with regular 

i 

students only, with the average difference being about one student out of 19 
in reading and one out of 24 in math. In the elementary grades, much of the 
instruction is -given in small groups rather than to the class as a whole. 
This is particularly true in the first two grades but, for reading, even in 
the sixth grade, 80 percent of the instruction is in groups rather than the 
whole class. Title I students receive much more of their instruction in 
si tall groups. 

The number of students in a class and the size of the instructional group are 
potential indicators of the quality of instruction. These are both favorable 
for Title I students • 3ut. probably more important are the teachers and the 
methods used in instruction . The teachers of Title I children, tend to have 
less teaching experience than do the teachers of regular students. This is 
true of their total years of teaching experience and of « their tenure in their 
present school. However, the teachers of Title I students tend, to have had 
more college courses in instructional techniques and more inservice training. 
Both groups had similar amounts of total college training. In Report 10 it 
is shown that the' total amount of teaching experience is associated with 
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higher student achievement. While- the differences are not large, it is of 
concern that the teachers of Title I students have less teaching experience 



than the teachers of regular students. 

The setting in which Title I students receive their instruction is quite 
different from the setting for regular students. For both reading and math, 
Title I students receive considerably less instruction in the whole-classroom 
setting from regular teachers. In contrast, they receive more of their in- 
struction from special teachers, teaching assistants and aides , in small 
groups, both within a small part of the classroom or in some other room. 
Regular students- receive more of their instruction from regular teachers in 
the regular classroom and they engage in considerably more individual study 
on their own. The major difference between Title I students and regular 
students is the difference in the amount of instruction in small groups with 
instructional personnel other than regular teachers. 

Title I instruction frequently takes place in a pull-out setting. Although 
some have been critical of the use of pull-out settings, our data shows that- 
this setting should be conducive to learning. The pull-out groups are two 
and a half time smaller than regular instructional groups, and each student 
has almost three times as much staff time available. In pull-out settings 
40 percent of the groups were taught by a CE or specialist teacher with 
special instructional" material or equipment. In the pull-out setting, a 
larger percentage of the students were 'on-task' than in-other settings. 
tSenerally, the setting for pull-out instruction seemed superior to that for 
regular instruction. To us, as researchers, it seems appropriate that the 
Title I students should receive instruction in small groups but we believe 
it would be preferable that the instruction be given by the regular teachers, 
since, as shown in Peport 10, students seem to learn more when instructed by 
regular teachers. ~ 

We examined in detail the kinds of activities and approaches used in teaching 
reading and math to Title I and regular students. There tended to be similar 
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practices in the first two grades but then large differences appeared in the 
higher grades. In generalizing over the different activities, it appears that: 
both the Title I and the regular students receive instruc-ion in basic sub- 
jects in the lower grades, but, as grade increases, the regular students 
receive instruction in more abstract and advanced materials while the Title I 
students continue to be taught more basic subject matter. The use of a number 
of different approaches was examined. In the first grade, both Title I and 
regular students were most frequently taught reading through ' graded sight 
phonic analyses, 1 'graded letter sound relationships, 1 and 'literal and 
implied' comprehension. ' 3y the sixth grade the methods used to instruct the 
Title I students were completely: different from those used to instruct" 
regular students. In the sixth grade, the three most frequently used methods 
with Title I students were the least frequently used with regular students, 
and the three most frequently used with regular students were the least 
frequently used with Title r students. For the regular students in the sixth 
grade, the most frequent methods used were 'literal and implied comprehension,' 
•reading in content field,' and 'literary forms and appreciation.' In con- 
trast, the three most frequent methods used with Title I students were 
'modified alphabet, 1 'self instruction with reinforcement, 1 and 'student 
reading own 'writing.' It is clear that the methods used with Title I students 
are different from those used with regular students. 

There are also differences in the methods used in teaching math. Relative to 
regular students, Title I students receive more math instruction by "learning 
about the structure of number systems," 'working with math games,' 'working 
with ohvsical models,' and ' le aiming about sets. 1 

" Finally , tr.are are data on the uses of teaching materials and audiovisual 
equipment. Title I students,, particularly in reading, tend to receive ^ore 
instruction from non-textual material and frca audiovisual equipment. 



32 



1-10 



,1 



It is clear that Title I students receive instructional services that are in 
addition to / and different from, the instructional services of regular students. 
But it is not so clear that these services add up to a net positive effect. In 
theory/ receiving more reading and math instruction in small groups from instruc- 
tional personnel who can devote more individual attention to the Title I 
student should result in greater learning, but while the Title I student is 
receiving more reading and math instruction, the regular student is frequently 
receiving instruction in a different subject or a different setting, but: still 
getting something the Title I student is not. Also, the regular student is 
more frequently receiving the instruction from a regular teacher with more 

— teachin"g — e"xpexien'ce~-than~~th'e-~special "i n s tr uc tro n~arl~-p exsonn el — rns-tr uc-t-i^rvg — feh e 

Title I students. 

After the first two grades, the methods and techniques used in instruction for 

the Title I student and the regular student differ. Title I students tend to 

be instructed at a more elementary or basic level, while the regular students 

are receiving more advanced and abstract instruction. The methods used with 

the Title I students in the higher grades are quite different from those used 

with regular students. It is not intuitively obvious that the methods used 

with, the Title I students are the best methods that might be used. It is also 

clear that Title I students 1 teachers more frequently use non-text teaching 

materials and audiovisual aids, but from results an Report 10 it is not clear 

that these materials are helpful; it is possible that they are used because 

they are available, and that they are available because there is Title I money 

to buy them- In Chapter V we will examine the extent to which Title I services 

» 

seem to . lead to greater learning. 

HIGHLIGHTS 0? CHAPTER IV - WHO RECEIVES COMPENSATORY EDUCATION? 

There are many kinds of Compensatory ■ Education programs. The Sustaining 
Effects Study was mainly concerned with Title X of the Elementary and 
Secondary Education Act, but since Title I operates in an environment that 
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includes other CE programs, it was necessary to consider both Title I and the 
other programs in evaluating the effects of Title I. Congress mandated the 
Participation Stir- -rvl specified that information be obtained on the number 
of students receiving and not receiving Title I services as a function of, 
first, the poverty status of the students and, second, as a function of the 
academic achievement of the students. To obtain the economic status informa- 
tion, home interviews were conducted with a random sample of about L5,000 
parents of students in the study. The students all took achievement tests in 
reading and in math during the fall of' the 1976-77 school year to provide the 
ih formation ' academic achievement. 



The results show that among students coming from a poverty* background, 40 per- 
cent receive CE services** and 60 percent do not, while for students coming 
from a non-poor background 21 percent receive CE services and 79 percent do not. 
In terms of the receipt of CE services it is clear that a greater proportion 
of poc.c students receive CE services than do non-pcor students. However, 
because there are many more non-poor students than there are. poor students, 
~ the number t* non-poor students receiving Title I is greater than the number 

of ;:oor students receiving such services (1,690,000 and 1,230,000 respectively), 
In the same population of students there are about 2 , 500 , 000 poor children not 
rejti".'.-?-g CE services and about 12,600,000 non-poor students also not receiving 
CE. To the extent that the Congress intended Title I and other CE programs to 
be programs for both' the poor and the educationally needy, it seems that there 
are many poor children who are not served while at the same time there are 
many non-poor children who are receiving CE services. 

However, it is not clear that it was the Congress 1 intent that Title I was 
largely to serve the poor; rather it may be argued that it was the Congress' 
intent to provide services for the educationally needy. Of those students 

♦See Chapter IV and Report 2 for a discussion of how poverty was defined. 

.**These figures are for all CE* Generally the trends are the same for Title I 
and other CE, but there are some differences. For data on these differences 
the reader should consult Chapter III and the relevant technical reports. 
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whose achievement: is one grade 1*3 vol or more below their assigned grade level 
(low achievers), 31 percent participate in Title I. Among those above this 
level of achievement (regular achiever:!)/ 10 percent participate. But there 
are many more regular-achieving students in the nation than there are low- 
achieving students, so there are about 2,000,000 low achievers not receiving 
Title I services, while there are 1,300/000 regular achievers who are. 

Certain undesirable measurement problems are associated with using grade- 
equivalent scores / so the data were also analysed in terrcs of percentiles. The 
percentage of students being serviced by C£ increase? progressively as the 
achievemen t "percent ile^ Nevertheless / among students above the 

national median in achievement level/ 4 percent participate in Title I. In 
terms of absolute numbers this is about 450,000 students. There are about 
2,500,000 students below the average who receive Title I services.* 

In judging the success of Title I in reaching the intended students/ one is 
faced with the ambiguity of Congress' intent.. Some feel that CE programs are 
primarily for the poor and some feel they are primarily for the educationally 
low-achieving. It is usually assumed that there is a high degree of relation- 
ship between poverty and school achievement, and thus if one criterion is 
satisfied, the other will automatically be also. This is not the case. The 
relationship between economic status and educational achievement status is 
very modest when viewed at the individual student level. Tf one knows the 
economic status of a student, one can predict his academic ..achievement somewhat 
better than at the chance level,, but not by a very large amount (the correla- 
tion is .30). The relationship is considerably stronger at the school level 
(.67). While students are selected for Title I as individuals/ they must be " 
in a school having Title I funds. Thus, funding schools in terms of poverty 
criteria tends to make Title I available to the most educationally needy 
students. 



*The numbers presented depend on the definition of poverty and achievement level 
With. different definitions the numbers vary. See Chapter III and Report 2 for 
numbers using different definitions. 
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When the joint relationship between poverty and achiovoment, and election for 
Title I are considered, the relationships bo coma mare complex. Whoa ail 
elementary school students are considered, then among the poor and low 
achievers,* 40 percent receive Title I and 60 percent do not; among those who 
are non-poor but low achievers, 26 percent receive Title I and 74 percent do 
not; among the poor who are regular achievers , 22 percent receive Title I and 
73 percent do not, and among the non-poor and regular achievers, 8 percent 
receive Title I while 92 percent do not. In terms of absolute numbers it is 
clear that a large number of students who "are non-poor and regular achievers 
are receiving Title I, about 863,000 students, while there are about 1,625,000 
receiving Title I in all the other categories. 

What do all these percentages and figures mean in terms, of Congress' interest:? 
First, it is clear that in a general way the intent of Congress that Title I 
funds should go to the poor and the educationally disadvantaged is being met. 
It is the case that poor students receive Title I services relatively more 
frequently than do non-poor students; similarly low-achieving students receive 
Title I services relatively more- frequently than do higher-achieving students. 
3ut because there are more non-poor students and there are more regular- 
achieving students, the absolute number of children receiving Title I services 
is larger,, among both the non-pcor and the regular-achieving students than it 
is among the-poor and lower-achieving. While the general intent of Congress 
is being met, there are large numbers of students receiving Title I who do not 
fall within the intended target groups. 



There are a number of reasons for this apparent misallccaticn of services 
Most frequently principals and teachers report that they use some ccmbina 
o 



f teacher judgment and tests to select students for CZ services . Both of 



*"Low" and "Regular Achievers" are defined here as being below or above one 
vear below grade level. As discussed later, selection for Title I is based 
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year below g 
on a different criterion- 
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tho.ne methoda ot: ann Lcjnmonfc are aomowhat unc0.Lj.4bla and will mUola^uny noma 
gtudunua. Also, within a given school dlatrlat, sotnu schools will receive Ctt 
funds and others wlU not. When the ii'tudonta in a particular school are 
selected Cor CP., some will bo selected who are Ions educationally needy than 
are low-achieving students in other district schools without CE. Also, acme 
schools can bo designated as 100 percent Title I schools and all students will 
receive CE whether or not they need it. There are also significant regional 
differences in the distribution of achievement scores, Title I funds are 
generally distributed to districts based on national poverty criteria, but 
the selection of students is based on local academic need, Thus, since there 
are regional differences in achievement, some schools in higher-achieving 
regions will have the funds to enable them to select students for Title I 
whose achievement would be too high to be selected if they were in a region 
populated with lower-achieving students 

Many analysts and administrators reviewing these data note that from the per- 
spective of the national academic achievement, the number of regular-achieving 

'students receiving Title I is so large that the whole selection system should 
be carefully reexamined. Congress should be more definitive regarding the 
intent of the Title I program: if it is a program simply for the educationally 
disadvantaged it will be aimed at a different, but moderately overlapping 
population. The present selection system results, at the national level, in 
many children receiving Title I who, from a national perspective, do not need 
it, and at the same time there are many children who need Title I but do not 
receive it. The solution to this problem requires a clearer definition of 
the intent of Congress and probably the funding of "a. larger Title I program- 
As. will be seen later, Title I does have a positive impact on achievement and 

"providing Title I services to many educationally needy students can raise 
their levels of achievement. A better selection of students .to receive Title I 
services would help soiraa, but even with the best selection system "there are not 
enough funds to serve all students who are below the national average. However, 

J < 
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ovoa cit/tho prusienl: loval of funding* « P' 1 "'"- 1 - ^lactlnn ayst-nn would allow 
the offering ot! Title Csorvlcaq to All who aro one or mora yuara bo low grade 
la vol. 

While the relationships among poverty, educational achievement, and selection 
for CS constitute the major focus of Chapter HI, other important findings 
are related. In terms of selection 'for CS , Hispanica are selected relatively 
most frequently, followed closely by blacks, and then somewhat further behind 
by whites. This appears to be the proper order in terms of what we know, about 
relative achievement. In terms of urbanism, • students from large cities and 
rural areas are, relatively, selected most frequently. This .is particularly 
true for the Title I program. Surprisingly, when all CS" programs combined are 
considered, the suburbs show the highest relative frequency of selection for 
low-performing students. " This is because the .suburbs offer a proportionately 
larger amount of services to students from other than Title I. funds . This 
implies that if a student in the suburbs, is low-achieving, the local community 
or the state will find CS funds to support extra service. In terms of regions 
of the" country, the West and the Northeast have the highest relative selection 
rates of students for CS services, while the South and Mid-Atlantic ha£e the 
lowest. However, the South is the highest for Title I but lowest for CS 
programs funded from other sources. These differences in regional and urban 
selection rates interact with the "source o'f funding o f "CS - services . National 
programs interact with state and local programs, and the fairness of distribu- 
tion of .iationally- funded programs depends on whether one believes that one 
region of the country should benefit at the expense of another because of its 
relative poverty. 

There are sex differences in the rate of selection for CS. Boys receive CS 
services more frequently than girls. However, this should not be attributed 
to sex discrimination. It is well known that in the lower graces girls have 
somewhat higher achievement scores than hoys and thus the boys have a some- 
what greater need for CZ than girls- The differences in selection rates are 
small, and it seems that the schools are not intentionally selecting students 
to receive CE services on the basis of gender. 



Finally, Chapter nil oondidtscg how zitudouta avo aulcictad nor OH a:i r.v po rt«jd 
by principals and b^acharq, Tlvn*a U a multitude an dltrforant niur.hodti us rid, » 
but tuaahut, 1 ^ 1 judgments and teat; sjcora^ atra used motit; ciroqunntLy , Th»a chapter 
alaems with a d.Uiausaion oi? how a t aerating index might hu dwvG.lopod, Tha 
idoa if\ to develop au index that; would tell how well a tycshool ov iHrttirLot Ui 
doing in selecting students Cor CE. A number of Indices ace oamiLdorMd and 
it ia concluded that it is feasible to develop such an index, depending an 
how comprohonaive.it should be and how many resources are available for com- 
putation. Technical Report 13 contains a table that aununacl-sua the relevant 
features of each index and indicator how well it fulfills a numb or of 
requirements . 

HIGHLIGHTS OF CHAPTER V - HOW EFFECTIVE IS COMPENSATORY EDUCATION? 

This chapter examines two questions. First, it considers whether Title I 
students gain relative to a comparison group- of similar needy students who 
do not receive Title I services. Second, it examines the evidence to deter- 
mine if there are school practices, instructional techniques, staff character** 
istics/ and organizational settings that increased educational achievement. 

There is also discussion of how students were classified as 'Title I, 1 

1 Regular Needy, ' and 'Regular 1 students. Briefly, 'Title I' students are 

selected to receive Title I services, 'Regular Needy 1 students are students 

judged by teachers to need CE services but Qot receiving any, and 'Regular 1 

students are not judged to need CE nor are they receiving any. The method 

of defining a student's status is not straightforward; it is complicated by 

the fact that over a period of three years a student may belong to each of 

► 

the aLbove groups. Because students frequently change .from one group to 
another, the composition of the groups changes, particularly at the 
beginning of each school year. Because the Title I and Regular Needy groups 
are composed of relatively low-achieving students, at the beginning of the 
school year these groups tend to have lost the previous year's higher- 
achieving students as the better students are 'promoted out 1 to the Regular 
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TUU I an- 1 ! M,(ni.;ii: Muu.ly ../roups Uaau.^*. i.n Mu'i IV^juU;: jimul- I i l ; 

rjrautenta a:::i uiuU:u.l by t:J\u h-L-jhu anh i .u v Ln-j .iUutenM CL^m 1 --'W^r • ::\ i m'-M r; | 

groups, HiH::Aiu,it:i or I'Iuuuj aluuuj'-M in gp-mp [ttu:nN..i vsJUi' r!i«*rfci nuty i*«a an iip;..u ! «in' 
Lnu^KUM In t:hu fti.'h UiVM((\ont gap hntwoun groups or ft«.v;ptlai< i f ;udr>nt : i aiv-t 
Tifclo X and Regular Moody gtudanfcii aa gradn Ltioiromi^ti , LlkowL-u*, tSwi tf.:i»u; 
that: chora are fiawar Title I students in the higher gvadas further uicro ^s^i 
Ch-i apnacmt gap, uinoo f.ho Titla I 9tudoat-.fi aro gonnrally r.h.» Inwo^-.v-hi -vi n ; 
atudnnc-i. re thora asa ffowor Titlo t a tauten tin and thoy aw tho mo-it: .uUica- 
tionally naady, than as thuir proportion oC ,\ <:las>i !'..v:otuog amallor Th* .wor-Ago 
different between those Title I studontn and regular studontti will inc:r<*a;u> , 
Thus, the so-called increasing achievement gap bo two on Title I students and 
regular students is partly the result of the working of CS. policies, 

.Chapter V examines the evidence for achievement gains based on the data for 
one school year, and for three-year longitudinal data. Graphs are presented 
that show the relative growth of Regular, Title I , and Regular Needy students, 
Title I students in grades 1, 2 and 3 grow at a faster rate for reading than 
similar Regular Needy students- The Title I students do not grow at quite as 
fast a rate as the Regular students in grades 1 and 2 but seem to grow at a 
slightly faster rate in grade 3. For grades 4, 5 and 6 in reading, all three 
groups seem to grow at about the same rate. Thus we conclude that, for reading, 
Title I seems to have- a positive effect in grades 1, 2 and 3 but: not In the 
other three grades. For math, the picture is considerably more positive. In. 
all grades for math the Title I students improve more than the comparison' "group 
cotuposed of Regular Needy students- Furthermore, the Title I students appear 
to improve at a faster rate than the Regular students, while the Regular Needy 
.students grow at a slower rata than the Regular students. We conclude that 
Title I services have a positive effect in math at all six. grade levels. The 
results of the three-year longitudinal study generally confirm the results for 
the first year. A number of different analyses shew that the less disadvantaged 
Title I students benefit from a year of Title I services and are 'promoted out. ' • 

40 • 
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However, the most disadvantaged students usually received Title I services 
during all " three years of the study and-- B dtd-n"ot=^©w-^«ela-tive--gains.-,^.: - 

There is a discussion of the reasons why Title I may be more effective in 
math than in reading, ft is suggested that learning to read is 
not limited to the schools. Children practice reading at home, in shopping 
malls, on the street, most everywhere. On the other hand, math is largely 
learned and practiced in school. Thus, additional Title I exposure to math 
is of much greater consequence . 

Chapter V also examines the educational practices and other factors that 
might be associated with improved educational performances. Among the factors 
investigated were.: student background characteristics, the amount and kind 
of instructional services, the type of school and instructional setting, the 
characteristics of instructional personnel, the characteristics o*f the 
instructional environment, and the characteristics of instructional practices. 
The effects of these variables were explored by a number of different tech- 
niques, such as regression analysis and causal modeling. Generally, no strong 
relationships were found between any of the school-related variables and 
increases in achievement. There were some relationships that were statis- 
tically significant but not strong enough to clearly guide policy. The most 
noteworthy findings were': 

•- Students of more experienced teachers achieve more for in both 
reading and math. 

c 

• The amount of regular instruction and tutor/independent work shcw£ 
some positive, but modest, effects on achievement growth. In con- 
trast, the amounts of instruction by special teachers or in very 
small groups does not often contribute to the explanation of achieve- 
ment growth, and when it does, a negative relationship is observed. 
This is probably due to the fact that these services are dis- 
proportionately received by the lowest potential achievers. 




rn hnj-h jading j^d_m ath , temp orary disruptions of instruction tend 

to be unfavorable conditions for learning in the upper grades but not 
in the earlier grades . 

• The frequency of feedback on progress sometimes relates positively to 
reading and math achievement growth. 

• In reading only, a teachers' effort in planning and evaluation shows 
a positive relationship to achievement growth in some grades. 

School principals expressed a very ' positive attitude toward CS. Teachers 
expressed both positive and negative attitudes. There was considerable 
evidence that CS students had a positive attitude toward CS and. did not feel 
stigmatized. 

In summarizing this chapter, the evidence indicates that Title I services are 
positively related to achi evement in reading in the first three grades, and 
that Title I services are positively related to achievement in math in all 
grades'. But just what aspects of Title I services are responsible is not clea: 
Students who receive instruction from more experienced teachers seem to profit 
more than those "receiving instruction from less .experienced teachers. Also, 
instruction in the regular classroom setting seems to be a positive factor, 
as does receiving instruction in. a setting without disruptions. 

.From a practical, point of view, the implication of the finding that Title I ' 
can help students improve their performances in basic : skills is that Title I 
services should be increased so that they might be available to all educa- 
tionally needy students if our goal is to help all educationally needy student 
improve their achievement. Since only about half of all the needy students 
are now receiving Title I services, this would require a very large increase 
in the amount of Title I funding. A political judgment is required as to 
whether the amount ■'■ gain is sufficient to justify this increased funding, 
but it is clear, that a very large number of children who could benefit frc 
Title I services are not receiving them. 

42 
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The findings also suggest that educationally needy students should be the ones 
to receive instruction from the most experienced teachers in a regular class- 
room setting- At present this tends not to be the case. Title I students 
tend to receive instruction from less experienced teachers, and not in the 
regular classroom. While pull-out settings have characteristics favorable to 
learning, it would probably be better if these same characteristics could be 
.obtained with regular teachers in the regular classroom. These axe matters 
that could be corrected at the local district and school levels. 

HIGHLIGHTS OF CHAPTER VI - HOW COST-EFFECTIVE IS COMPENSATORY EDUCATION? 

It seems reasonable to many that as more resources are made available for the 
instruction of low-achieving students, the achievement of the students should 
increase. One of the assumptions underlying the federal funding of educational 
programs is that poor school districts are not able to marshall enough local 
resources to provide the extra services to help low-achieving students to 
improve their performances. Thus, it is hoped that the federal funds will 
help improve the performances of these students. We attempted to test these 
assumptions by investigating the relationship between the amount or cost of 

. resources used and changes in student achievement. The finding is that there 
is no positive relation between the total cost of the personnel and other 
resources used in instruction and growth in achievement. Because this finding 

-is— contrary to conventional wisdom and the assumption underlying Title I (and 
many other social programs) , it deserves to be scrutinized carefully. 

Early studies of cost-effectiveness were usually based on obtaining the total 
expenditures involved in a CE program and dividing them by the number of par^ 
ticipating students. This gives a per-pupil cost, but there are many reasons 
why this approach gives untrustworthy results. In an attempt to overcome the 
limitations of this approach, researchers have recently developed a resource- 
cost model based on the idea of applying a standard price to each service 
actually received by students in their instruction. This bottom-up approach, 
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as contrasted with the top-down approach, starts with a teacher's report of 
how much instruction each student receives. Standard prices are developed 
for each element of instruction given. These price? are uniform for all 
students and thus ignore actual variations in teacher salaries and the cost 
of instructional material from one region of the country to another. The 
basic assumption is that a teacher with a certain amount of education and 
teaching experience does as effective a job in one location as in another. 
Thus, a uniform, common metric is developed and used to cost the instruction 
received by each student. Chapter VII reports the results of applying this 
resource-cost technique to the SZS data. Achievement gains were studied in 
relation to the cost of' instruction. Overall the results show that there is 
no significant positive relationship between these two variables. For some 
grades there seems to be a . slight positive relationship but it is countered 
by other grades with slight negative relationships. In Report 7, detailed 
statistical tests are reported and the overall conclusion is that there are 
few statistically significant trends and, where they are significant, they 
tend to be negative. This negative correlation means that the more costly the 
services a student receives, the less the achievement gain mace by the student. 

It can be argued that. the slightly negative relationships found are due to 
the fact that more resources are given to the more needy students than to 
less needy ones. It is argued that the most needy students will have more 
difficulty in improving their levels of achievement than less needy students 
and thus the negative relationship found is determined by the nature of the 
students, receiving the more costly services rather than the ineffectiveness 
of the increase in services. This idea was investigated and it was found 
that lower- achieving students do receive mere costly services than higher- 
achieving students. While the relationships are not strong, they are at least 
large enough to support the idea that the negative-relationship between cost 
of service and achievemer t gain is a function of the achievement level of the 
students being served. 

44 
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While it is possible to offer explanations for the negative relationship , it 
- is still important to ask why a fairly strong positive relationship was not 
found . The idea that increasing the funding , and thus services co needy 
students, will lead to increased achievement is so pervasive and fundamental 
to federally- funded programs that these findings need to be most carefully 
examined for faulty analysis. One way of checking the possibility that the 
results are due to a faulty . resource-cost model is to undertake the same 
analyses using total hours of instruction received by the student. The use 
of hours of instruction received is independent of any cost model and in a 
sense is more basic than a cost-effectiveness analysis- Yet the results are 
the same as those found with the resource-cost model . 

The resource-cost model used has been criticized by some researchers as faulty. 
We believe these criticisms are not valid; nonetheless, the importance of the 
relationship between the cost of services received and gains in achievement 
is such that we recommend that an independent analysis of the SES data be 
undertaken. We believe it is important either to confirm the results reported 
here or to clarify the methodological problems in such analyses. 

HIGHLIGHTS OF CHAPTER VTI - WHEN AND .FOR HOW LONG SHOULD STUDENTS RECEIVE 
COMPENSATORY EDUCATION , AND WHAT HAPPENS TO. THE ACHIEVEMENT OF STUDENTS WHEN 
, THEIR COMPENSATORY EDUCATION SERVICES ARE DISCONTINUED? 

Opinions differ about the best grade in which students should receive compen- 
satory education. Some have thought that compensatory services should be con- 
centrated in the primary grades, particularly in the first and second grades. 
This- was based on the idea that if students received assistance early, they 
could catch up with students entering at a higher achievement level. Others 
have argued that additional- services should be available at whatever. grade 
the student demonstrated a need for the services. We examined this question 
using several different methods. The result was that there is no one grade 
where CE is most effective, but there is evidence that it is most effective 
in the primary grades. 
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Another concern has been the optimum . Length of CE services. Some have felt 
that one year's worth of services should be sufficient, while others have 
urged that the same child should receive services for as long as needed. 
Again we could find no evidence to support either position. Rather, there is 
an interaction between the level of achievement of the student and the 
benefit derived from CE. Students who are selected for CE but achieve at a 
relatively high level seem to benefit from one year of CZ services, while 
very low. achieving students do not seem to benefit; from services . at the 
intensity they are receiving them. Thus we cannot say that there is a general 
optimum length of CE services. 

There has ...been considerable concern over what happens to students when their 
CE is discontinued. Particularly in Title I , the goal is to serve the most 
needy students. From year to year, the particular students to be served will ■ 
depend on a number of factors such as the availability of funds for CZ programs 
in specific grades and subjects. When students whose achievement levels in- 
creased during the year are considered for services the next year, it may be 
that they have progressed sufficiently, in comparison to other students with 
lower achievement levels, 'to make them no longer the most needy. It has been 
argued that, as soon as these students begin achieving at higher levels, they 
are promoted out of CE programs and thus lose the impetus that has built up 
and then may fall' back to previous lower levels. 

In the Sustaining Effects Study we examined three questions related to this 
problem. First, we studied the. frequency of changes in CE participation of 
students from year to year to see if it was frequent enough tc merit attention f 
next we determined whether or net there really was a change in the instruc- 
tional services received by students once :.hev had lost their CE status; and 
finally, we examined whether those students losing their CE services continued 
to achieve at a relatively higher -level or reverted to the lower level 
characteristic of CE rtudents. The findings are relatively clear. Among CE 
" students there is considerable change in status from year to year. Among 
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Title I students, about 40 percent of the students who received Title I 
services in one year will not receive Title I services the next year. There 

programs, the turnover figure is about 80 percent, and for state and. local 
programs it is about 65 percent. Thus it is clear that there is a large 
amount of student turnover from year to year. Next we examined the hours and 
costs of instructional services offered to regular students, to students whose 
CE programs continued from one year to the next, and for students who had 
received services in one year but had their services discontinued for the 
second year. The results show quite clearly that regular students receive 
services costing considerably less than CE students and also that .the students 
who had received CE services the previous year, but were not now receiving 
them, got services that cost about the same as the cost of services for 
regular students , rather than the cost of services for CE students. Thus, 
we know that there are' many students who have their services discontinued, 
and that. the services they receive subsequently revert to those received by 
regular students. What happens to their achievement levels as a result of 
^Xs~Sange? "fThe"1:es^Its^ re~ce~ived~ 
CE services since they were no longer qualified because of relatively high 
achievement continued to maintain their achievement growth during the next 
year. In other words, there do not seem to be deleterious effects resulting 
from the discontinuation of CE services. The policy, implication of these 
findings is that there is really no great problem associated with the turn- 
over of CE students who lost services because of high achievement. While it 
may be wise to give school personnel, flexibility to handle the cases of 
individual students judged to remain in need of CE services, there is not a 
national problem of CE students being 'promoted out* only to fall back 
because their CE services were discontinued. 

4 

Although the Sustaining Effects Study was not designed to follow students 
into high school, it became apparent in the later stages of the study that 
it would be desirable to try to obtain data on students in high school, to 
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see if we could detect any long term', sustained effects of CE. A snail 
sam ple of stude nts was followed ' into the seventh, eighth, and ninth grades. 
The students werT 'tested for reading and "SltK^irveSBire;, and mrormation 
was gathered on the courses they took in junior high-school. We found no 
evidence that achievement effects of CE in the elementary grades carried over 
into junior high-school. However, the data available for making a definitive 
test were not available. The former Title I students took more remedial 
courses in junior . high-school than other students who had not been Title I 
students. We also found evidence that the students' socio-economic back- 
ground still played- an important role in achievement levels even as the 
students moved through the junior high-school grades. We believe this pcrtic 
of the study should be viewed with caution because of the difficult nature of 
the problem investigated and because of the less than ideal data available. 

HIGHLIGHTS OF CHAPTER VIII - WHAT HAPPENS TO STUDENT ACHIEVEMENT OVER THE 
SUMMER, AND IS SUMMER. SCHOOL EFFECTIVE? 

-ja-1-gr^ps-o.f..studen^ 
But what happens to that growth over the summer? To what extent do students 
continue to mature even though they receive no formal instruction? We have 
already seen- that during the regular school year the rate of growth for CE 
students is roughly equivalent to that of regular students. Some have 
sugge sted that during the summer regular students' continue to improve due to 
informal learning experiences, but that CE children lack both the motivation 
and" resources to engage in these informal learning activities. However, the 

■ evidence is less than clear-cut. Some have argued that, for all students, 
achievement suffers an absolute decline over the summer; other evidence sug- 
gests that CE students suffer a loss relative to regular students. It has 
been further suggested that among CE students those who achieved the highest 
gains during the regular school year suffered the sharpest losses during the 



summer 
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Based on these ideas, it has been suggested that summer school has an un- 
usually important role to play. If C£ students have learning emeriences 
during the school year that enable them to achieve more, it is important 
that efforts be made to continue or maintain the benefit, and summer school 
seems a reasonable way of doing it. Since summer school classes are avail- 
able to only about half of all students, it has been argued that their 
availability should be increased, particularly so that they would be avail- 
able to CS students. 

The question of whether achievement levels increase or decrease over the 
summer has implications for both the evaluation of CE programs and for the 
wisdom of funding summer schools. Starting in 1976, research indicated that 
there was an absolute loss in achievement over the summer and that CE 
students lost relatively more than regular students. This research was 
influential in shaping federal thinking about the whole question of the 
intellectual growth of CE students and the Executive Branch's position on 
legislation to increase support for summer schools. Since then several 
reports have produced data that seemed to refute the earlier conclusions. 

The Sustaining Effects Study provided a large amount of high-quality longi- 
tudinal data to evaluate these contentions. The results are quite clear. 
For reading, there is not a summer loss but a consistent gain for all grades 
and all kinds of students. For math, there is also a summer gain, but it is 
not as large as it is for reading. It is reasonable to suggest that in 
reading the students have considerable exposure to reading material over the 
summer, while for math there is less opportunity for summer learning. The 
earlier research had suggested that ' there was a relative loss for CE students 
in comparison to regular students. Here the SES results are less clear-cut. 
For the non-CE students in reading there is a decrease in the rate of growth 
over the summer in the lower grades but very little, if any, in the higher 
grades. For the CE students in reading there is a similar decrease in the 
lower grades / but considering' their slightly slower rates of growth during 
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the regular year, there may be slight scnner gains relative to r.on-CE students . 
In the higher grades, the CE students, in reading drop off slightly more than 
their non-CE peers. For math, the picture is somewhat different. 3oth the 
CE and the non-CE students show a lessening in the rates of growth over the 
Summer at all grades . The change . for CE and non-CE students is very similar 
with, perhaps, slightly larger drops for the non-CE students. In summary, 
the. results show that there may be a very slight overall relative summer drop 
for CE students in reading, but not in math. Neither the SIS data, nor other 
data reported by MIS, give credence to any large or particularly significant 
summer loss. 

It had also been proposed that CE students who were high achievers during the, 
school year lost more. than low achievers, where achievement was defined in 
terras of the level of performance, not in terms of gains during the school 
year.. The SES data show that low-achieving students continue to grow over 
the summer and at about the same rate as during the school year, and there is 
no significant difference between CE -and non-CE students. On the other hand, 
high-achieving students grow at a faster rate during the school year. For 
reading, 'non-CE high-achieving students continue 'to grow over the summer, but 
high-achieving CE students show a loss, particularly a relative loss. For 
math, both CE and non-CE high-achieving students show a loss over the summer, 
but the CE students have a larger loss. 

The importance to be attached to this relative loss for high-achieving students 
depends .on where the emphasis for CE resources should be placed. There are 
about six times as many CE students belcw the national median in achievement 
as there are above it. If the goal is to help the vast majority of CE 
students, can one justify exceptional resource expenditures for high-achieving 
CE students on the grounds that they lose more over the summer than their nor.-. 
CE peers? Cn the other hand, low-achieving CE students gain ever the summer. 
Perhaps low-achieving students would gain more if they had special summer 
services. It has also been argued elsewhere .that those CE students who are 
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high gainers during the school vvaar suffer high losses during the summer. 
According to this argument *>iss.-i students need the stimulation of intensive 
instruction to achieve hi',n gains and, lacking such stimulation during, the 
summer, they lcse more than those having smaller achievement gains. This 
idea was tested by separating those who, had high regular school-year gains 
and comparing them with students who had relatively small gains. Comparisons 
were made for both individual students and for school classes having high and . 
low gains. The results show that indeed those who had high school-year gains 
had quite high summer losses. Hut, at the same time, those who had low 
school-year gains had high summer gains. In other words, the result demon- 
strates the regression-to-the-mean phenomenon. Because of measurement un- 
reliability, the individuals at the extremes of both ends of a distribution 
tend to move toward the mean on any subsequent measurement. Thus, the over- 
all res- . largely due to statistical artifact and .do not represent a 
real difference in gains or losses between high and low gainers. 

From this wealth of data we conclude that ,there is no absolute summer drop-off, 
and that there may be a slight, but not particularly significant, relative loss 
for CE students in comparison to non-CE students. The more detailed analyses 
of high and low gainers, and of members of high-gain and low-gain projects, 
leads us to believe that reported relative summer drop-off is more of a 
measurement artifact than a reality.- 

The practical implications of these findings regarding the "summer drop-off 
phenomenon" are that it is not something that requires any special action or 
concern. Our findings, and those of others, do illustrate, however, that 
policy makers need to be very careful regarding the soundness of reports and 
the appropriateness of any actions based on them. In hindsight, it is diffi- 
cult to understand why some policy makers placed so much confidence in reports 
based on quite limited data which was expressed in a poor metric. 
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Some have suggested that students who have not performed well curing the 
regular school year should go to summer school as an additional learning 
experience that would help then in the coming school year. It has been 
thought that this might be particularly important for CE students who are 
having difficulty keeping up with their peers and, if high-achieving CE 
students lose a large amount of their school-year gains, it would be particu- 
larly important that they attend summer school to help mitigate such losses. 
Of course, summer school serves functions in addition to instruction in basic 
subjects. There are recreational, and special-interest classes that many 
students find attractive'. Summer school can also serve as a safe summer haven 
for children whose parents are working or need to be away frocn home. Summer 
school serves many purposes in addition to instruction in reading and math. 

About half of all students have summer school available either at the students' 
regular-year school or elsewhere in the school district, with larger schools 
more frequently having summer programs. Schools with a high concentration of 
minority students are more likely to have summer programs. About two-thirds 
of all summer schools derive some support from Title I funds, but only a 
quarter are completely supported by Title I. The average length of summer 
sessions is five to six weeks, which is 25 to 30 school days. The amount of 
reading and math instruction is not large. On the average, there are about 
17 hours of reading instruction and about 14 hours of math instruction . There 
is no difference In the amount of instruction as grade" level increases, nor do 
Title I students receive more instruction than others. However, CE students 
are more likely to attend summer school than non-CE students. 2y grade, the 
percentages of CE students who attend range, from 21 to 32, while the percentages 
of non-CE students who attend range from 7 to 20 . In terms of judgment by 
teachers of need for CE services, twice the percentage of 'needy 1 students 
attend summer school than the "not needy.' In terms' of achievement test 
scores, students attending summer school score considerably lower than those 
not attending-, and this is true among both CE students and non-CE students. 
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In judging the effectiveness of summer school*, it is not sufficient to show 
that students who attend summer school increase their" performances over the 
summer- Rather, one must compare students who attend summer school with 
similar students who do not. First/ we examined the summer growth of all the 
SES students who attended summer school and compared their growth with that of 
students who did not attend. For both reading and math, the students who 
attended summer school grew at the same rate as those who did not attend. 
Since these comparisons lump all students together, it can be argued that the 
results would be different for CE students, so we made two other comparisons. 
In one case we compared only CE students who attended summer . school with CE 
students who did not attend. In the other sample, we compared Title I students 
who attended summer school and were from schools offering summer school, with 
Title I students who did not -attend summer school and were from schools which 
did not have summer school. In neither case was there ,any evidence that 
students attending summer school performed better the next fall than those who 
did not attend summer school. 

All the analyses from the SES data discourage the idea that summer school, as 
it is now conducted, is an effective mechanism for improving the performances 
of CE students. As we compare students who attended summer schools with those 
who did not attend, we simply find that present summer schools are not effec- 
tive in raising basic achievement test scores . What effect should be reasonably 
expected from four or five weeks of instruction of less than an hour a day for 
reading or math? '-Then children are rapidly maturing in their reading skills 
and can have summer reading experiences without summer school, should we expect 
summer-school-related reading gains? In the data there is a hint that summer 
school in the higher grades may be effective in math, and, in comparison to 
reading, there .is less s umm er growth in math in the higher grades. Probably 
there is less opportunity for summer math-related experiences than there- is 
for reading. 
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We should not construe these results to mean that summer school cannot be 
effective. If summer school were longer, had more hours per day devoted to . 
basic subjects, and had experienced regular teachers, it might well result in 
achievement gains; but that is still to be demonstrated. , Indeed, we will 
never 'know how effective summer school cam be until a careful study is made 
of summer schools that are designed to give intensive instruction in the basi< 
reading and math skills. -If such summer schools proved effective, then there 
would be a sound educational basis for legislation to provide funds for 
similar summer schools for CE students. 

HIGHLIGHTS OP CHAPTER IX - WHAT CLASSROOM PRACTICES INFLUENCE LEARNING? 

We developed a model of the elementary education process based on information 
previously analyzed and our understanding of the education process* Iwe cailec 
this the rational model and.it consisted of the following factors: spring 
achievement scores and fall achievement scores and the gain between fail and 
spring, the socio-economic background of the students', their opportuhi ty-to- 
leam in the classroom, the instructional practices used by their teachers, 
the resources- available for their instruction, the characteristics of the 
schcol/staf f , the coordination of instruction, and the level of the principal 
instructional leadership. Using the techniques of causal analysis we tried tc 
develop am understanding of the relationship between these factors and how 
they affected student learning* 

In studying the relationships, we were particularly interested in the way eacl 
of the factors related to achievement and achievement gains . Fail achievement 
was most closely related to spring achievement, and the gain in achievement ■ 
was related in complex ways to the remaining factors* The relationship of 
socio-economic . background to achievement was mcdesc and the relationship to 
achievement gain was still smaller but positive. Opportunity- to- learn was 
broken down into three' subf actors : amount of time available for learning, th< 
amount of on- task behavior, and the overlap between curriculum content and te« 
content. The relationship between opportunity- to-; leam and achievement is 
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quite high for reading and math in the second ^iade for the poorer schools but 
not for the higher achieving schools; it is quite high for both reading and 
math at the fifth grade for all schools. The relationship of opportunity- 
to-leam to achievement gain is more moderate but still quite positive. In the 
model, instructional practices operate through opportunity- to- learn to 
influence achievement. A number' of different instructional practices were 
found to be positively related to opportun ity- to-leam . Resources also 
operate through opportuni ty- to-leam in influencing achievement. Smaller 
student/staff ratios were associated with higher percentages of students on- 
task, higher percentages of student time devoted to instruction, higher 
quality of classroom management, and higher level of direct student supervision. 
However, resources-available was not related to achievement, except in fifth 
grade math where the relationship was quite strong. Staff characteristics also 
operate through opportunity- to-leam. Years of teaching experience is somewhat 
related to achievement gain. Teachers' job satisfaction is fairly strongly 
related to achievement level and to achievement gain. Similar relationships 
were obtained for the characteristics of school principals. Coordination of 
instruction also operates through opportunity- to-iearn and is fairly positively 
related to both achievement and achievement gain. Principals' instructional 
leadership should influence opportunity- to-leam , but it was found that there 
was a negative relationship between principals 1 instructional leadership and 
student achievements. It is believed that principals in pcorer, low achieving 
schools exert stronger instructional leadership and thus, the relationship 
found is explainable in terms of the schools in which the principals work. 

Based on these relationships and the interrelations between each of the 
factors, the data were fitted to the rational model of the education process 
that had been developed. It was found that the rational model formed a good 
basis for modeling the educational process, but the actual process was con- 
siderably more complicated than the rational model had postulated. 
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HIGHLIGHTS Or CHAPTER X - WHAT 15 THE HOH3 SMV1SDNM2NT OF SLEM£!«TA?.'i SCHCOL 
CHILDREN? 

So far we have been largely concerned with the school experience of children, 
but to understand the child' s. total learning experience we should also look 
to' the child's home. In connection with the Participation Study, we inter- 
viewed 15,000 parents and asked a number of questions about the home environ- 
ment and particularly home-related learning activities. It was found tha 
usual home of ah elementary school child is a two-adult family home, with 
parents about 35 years old; they are white, living in a single family dwelling, 
and have graduated from high-school. While these are the usual character- 
istics, there are from 20 to 35 percent of the children who come 'from homes 
with different characteristics. At home the usual child spends about two hours 
a day playing, an hour doing chores, about two hours watching TV, an hour 
reading for pleasure, and an hour doing homework. Most of the children come 
from homes where the parents are involved in school related extra-curricular 
activities, and most of the parents attend parent-teacher conferences at least 
once a year. Over 75 percent of the parents rate the quality of their 
children's schools as excellent or good. Almost all of the parents expect 
their children to graduate from high-school, and over 25 percent expect them 
to graduate from college. 

When the home environment of Title 1 students is compared to that of regular 
students, the two home environments are quite similar. It will be remembered 
that a large number of Title I students come from non-poor homes. However, 
there is a slignt tendency for Title I students to come from homes wish less 
well-educated parents, from minority homes, frcm hemes with a somewhat less 
intellectual environment, and with somewhat lower expectations regarding 
s chcol a tt airmen t . 

These findings remind us of the number of factors in addition to the classroom 
that influence a child's learning environment, ttiile the above figures are 
stated in terms of the typical, or usual, child, the data also remind us of 
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the graat diversity of background from which children come. Also, che data 
emphasize the relatively high regard in which parents hold the schools their 
children attend. This is in quite marked contrast to the picture sainted in 
some of the media. While there certainly are individual parents who feel 
their children's schools are poor, and that their children are not learning 
much, these are far from the typical finding. The high regard parents have fo 
the schools and the high expectations they have for their children is more 
encouraging than we are often led to believe. 

HIGHLIGHTS OF CHAPTER 'XI - WHAT ARE THE CONTRIBUTIONS OF BACKGROUND AMD ' 
SCHOOLING TO STUDENT ACHIEVEMENT? 

It was usually assumed that both schooling and background factors contributed 
importantly to the achievement of students. However, with the publication of 
Coleman's Equality of Educational Opportunity , the question was raised as to 
whether or not schooling made much of an independent contribution to children 
achievement. With the detailed data available in the Sustaining Effects Stud 
on both the student's home background, the characteristics of the schools, 
and the learning experiences in the schools, it was possible to examine the 
relative contribution of socio-economic background and schooling. Three 
different composites were formed for: Student Socio-Economic Background, 
School Characteristics, and School Learning Experience. The relationship 
between these and student achievement was explored using the techniques of 
casual analysis. It was found that while background characteristics were 
important determinants of achievement, the school learning experiences were 
also important, particularly in the early grades. The fact that the relation 
ship of level of performance from one grade to the next is lowest at the 
beginning grades indicates that there is a greater possibility of influencing 
future achievement in the first and second grades. Also, it seems that socio 
economic background- has relatively little direct influence on final achieve- 
ment, but rather that its influence is indirect, through initial achievement, 
school characteristics, and school learning experiences-. These facts tend to 
point to the importance of schooling, particularly in the early grades. 
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Summary 

This introductory chapter starts with a short history of the Sustaining 
Effects Study. Next is a discussion of the overall design of the study 
and of the way in which the sample was selected. Then theve is a descrip- 
tion of the instruments (tests j questionnaires , forms, etc.) used to 
collect data. This is followed by a short consideration of hou the daza 
Were collected and analyzed. The in-depth study of high-poverzy schools' 
is described. Finalluj there is a list of the reports issuing from the 
Sustaining Effects Study. 

A SHORT HISTORY OF THE SUSTAINING EFFECTS STUDY 

In March 1975 the U.S. Office of Education issued a Request for Proposal 
entitled "A Study of the Sustaining Effects of Compensatory Education on 3asic 
Cognitive Skills- 11 The. project soon became known as "The Sustaining Effects 
Study (SES)." The study was motivated by two major factors: one a mandate 
from Congress and the other the educational community's concern over the 
effectiveness of compensatory education (CE) - The Introduction to the Request 
for Proposal said, 

"A near decade has passed since Congress enacted the Elementary 
and Secondary Education Act (ESEA) which authorized the Federal 
Government: to join hands with State and local education agencies 
in a partnership designed to enhance the education of educationally 
disadvantaged children in areas with concentrations of children 
from low income families- During this period and under the 
authority of this legislation almost. fourteen billion dollars have 
been made available. These funds have aff ected • the school lives of 
six to seven. million children every year in myriad ways- The 
evaluation requirements of this legislation have helped to" create a 
national concern for the benefits that children derive from their 
years of schooling and for the costs of these efforts. 

Recently Title I of the Elementary and Secondary Education Act of ' 
1965 has been extended and modified in many important ways. In 
particular, the Educational Amendments of 1974 (P.L. 93-380) 
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direct the U.S. Commissioner of Education to expand his efforts 
to describe the actual and potential recipients of Title I ser- 
vices and to evaluate the effects of such participation . The 
evaluative study proposed herein is both a response to these 
new requirements and an outgrowth of prior experience in evalu- 
ating this program." 

The Educational Amendments of 1974 also instructed the National Institute of 
Education to undertake a series of studies which became known as " the Mis 
Compensatory Education Study." Mil was authorized to spend fifteen million 
dollars on those studies and entered into a number of contracts to study 
different aspects of Title I compensatory education. A list of the studies is 
given in the MIS Interim Report (22) . In addition, the Department of Health, 
Education and Welfare and the Department of Commerce investigated ways in 
which poverty indexes could be updated more frequently than every ten years 
through the census. Their report, "The Measure of Poverty" {32), -hows the 
impact that alternative method.** of estimating poverty would have or. funding 
for different geographic regions. This study and the MI 2 studies have now 
been published (see (23) for the final report on the NIE studies) . 

Much of Congress 1 concern regarding the effectiveness ar;c ocer^::ion of Title " 
stemmed from several evaluation studies which cast doubt on th'. effectiveness 
of compensatory education. Wargo, et al. (3-) reviewed a number o: evaluations 
conducted in the first five years of Title I and concluded that there v..?s 
little evidence that Titl* I had a positive impact, on participating s^ude.-its- 
Subsequent to that report, the Office of Education sponsored the Compensatory 
Reading Study (31), While the results were more encouraging, they were United 
in the number of grades .'studied and in the length of exposure of students to 
compensatory services . 

The first year of the SHS (19^—5) was devoted to planning; to selecting the 
sample and to persuading schools to join the study; to the selecting, develop- 
ing, and clearance o£ instruments; and ;:o the formation of various advisory 
groups. Data collection .started in the fall of the 1976-77 school year and 
continued for three successive years . 
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THE PURPOSE OF THE SUSTAINING EFFECTS STUDY 

The Sustaining Effects Study is concerned with a number of issues; there are. 
two major policy issues and five secondary issues. The two major issues are: 

x) Who receives Compensatory Education ? Among children coming from 

different economic strata, how many receive Title I, other federal, 
state, or local CE services? Similarly, among children performing 
at different achievement levels, how many receive Title 1, other 
federal, state, or local CE services? 

2) How effective is Compensatory Education ? Do those students receiving 
CE services benefit from such services? What are their performance' 
levels relative to students who do not receive CE services? Similarly 
what are their performance levels relative to students who are judged 
to need CE but who do not receive CE services? 

Secondary to these' two issues are a number of related questions: 

3) What is Compensatory Education ? Frequently we speak of Title I pro- 
grams as though they had a cohesiveness of content or method of 
instruction. To talk about the effectiveness of CE , we should know 
what CE is.' How does it differ from the .instruction children would 
have received if they had not been selected for CE? How does it 
differ from the instruction received by students not receiving CE who 
are in schools where CE is offered? 

4) What is the nature of the home environment of elementary school 
students and how is it related to school environment ? Questions 2 
and 3 above are concerned with school instructional programs and 
their effectiveness. Question 4 investigates the relationship of 
home environmental factors to school achievement. How is school 
achievement related to such factors as parents' educational and 
economic status, intellectual, stimulation in the home, homework, and 
p a rents 1 involvement with the school. 

5) What happens to the achievements of students when their CE services 
are discontinued? CE services are discontinued for a number of 
reasons. After receiving CE services some students improve to such 
an extent that, relative to other needy students, they are no longer 
eligible to receive CE services. Other students have CE services 

discontinued for administrative reasons , such as their new classes do; 
not offer such services. Still others lose CE services because their 
schools no longer offer CE services. If students have been receiving 
1 CE services, but these services are discontinued due to one or 

another of the above reasons, what happens to their achievement in 
subsequent years? 
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Is there an optimum duration and period for receipt of CE services ? 
It is sometimes argued that CE students need CE services throughout 
their elementary education. Others believe that concen tracing 
services in the first or second grade is most beneficial. Still 
other periods or durations receive support. ' What is the optimum 
time for and duration of CE services? 

What happens to student achievement over the summer and is summer 
school effective ? Do regular and/or CE students experience an 
absolute or a relative change in achievement over the summer? Is 
summer school effective in increasing the achievements of regular 
and/or CE students? 

a 

THE DESIGN Or THE SUSTAINING EFFECTS STUDY 

To obtain answers to the policy questions it was necessary to obtain a large 
amount of data through a very complex design. As initially planned the 
Sustaining Effects Study consisted of five* substudies,' which were: 

1- The Longitudinal Study , In the Longitudinal Study, educational 

achievement was assessed in the fall- and i spring for three consecutiv 
years. The children took achievement tests in reading and math, a 
functional literacy test, and a measure of attitudes toward school 
and toward themselves as students. The amount and nature of ins true 
tion in reading and math was determined for each student four times 
durifnfck the school year. In addition, teachers and principals 
repirt^d on their practices of instruction. Thus, it was possible 
not anift to assess student growth over a three-year period, but to . 
relate this growth to the kinds and amount of instruction being 
'received. 

2. The Successful Practices in High-Poverty Schools S tudy . This- study 
identified and described the instructional practices and contexts 
that appear to be effective in raising the reading and math achieve- 
ments of educationally disadvantaged students. In the longitudinal 
study data were obtained by formal tests, questionnaires <k'nd 
schedules. In the Kigh-Poverry Schools Study, these data were 
supplemented by ' in-depth 1 or ethnographic ma. terial obtained 
from 55 high-poverty schools that were a cart of the sample of 
the Longitudinal Study. 



* Another sub study was added later and involved following a limited sample 
of students into high school. 
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3« Tha Partic tpat ion Study . The purpose of the Participation Study 
was to determine the relationships among economic status, educa- 
tional need, and, instructional, services received. Data on the 
educational 'achievement of the students and the services they 
receive were obtained in the Longitudinal Study. Measures of 
economic status were obtained in the Participation Study. A random 
sample of over 15,000 students was drawn from the schools and 
visits were made to the homes of these students. During the visits, 
information was collected on the economic level of the home and on 
the parents 1, attitudes toward their children's schools and learning 
experiences. Thus, the level of student achievement and services . 
could be related to the economic level of and academic support 
in the home . 

4. The Cost/Effectiveness Study . Information was obtained on the 
resources and services to which each student was exposed during 
reading and math instruction. Cost estimates were generated on the 
basis of this information. Because achievement was determined in 
the Longitudinal Study-, it was possible to relate educational effec- 
tiveness to the cost of each program. 

5. The Summer Study . The Sustaining Effects Study also examined the 
effectiveness of summer -school programs . Information about the 
summer-school experiences of the students was combined with other 
data from the Longitudinal Study. The amount of growth over the 
summer was determined, as was the effect of attending summer school. 

THE SAMPLE FOR THE SUSTAINING EFFECTS STUDY 

The sample for the Sustaining- Effects Study was not ideal since it had to mee 
two somewhat conflicting objectives. For the Longitudinal Study it was 
desirable to have a sample of schools and students with a wide variation in 
the variables to be studied, such as the kinds of schools, the extent of CE, 
the nature of instructional practices, the kind of school leadership, the 
abilities of the children, and the level of the- funding. On the other hand, 
the Participation Study required that projections be made for the nation's 
schools regarding the number of students receiving CE services, such as 
Title I. It was also necessary in the Participation Study to report the 
number of students at various poverty levels who were receiving CE arid to 
find the number of children at various levels of academic achievement who 
were not receiving CE services. Since the federal government ' was funding 




Title I programs ac a level of about three billion dollars ?. year, it was 
particularly important that the study be able to describe the effectiveness of 
Title I activities. To meet these requirements, three different samples were 
formed: a Representative Sample, a Comparison Sample, and a dominated Sample, 

The Representative Sample , The Representative Sample was drawn to be 
representative of the nation's schools. It was a stratified, random 
sample. Three stratification variables were used, namely: ■ geography, 
size of the school district, and a district poverty index. The technical 
details describing how the sample of 243 schools was drawn are recorded 
in Technical Report »1. in that report there are a nuniber of tables 
showing comparisons between the characteristics of the Representative 
Sample of schools and population estimates derived from other sources . 
From these comparisons, and from the sampling procedures used, it is 
concluded that the Representative Sample allows quite accurate" projec- 
tions of the characteristics of the nation's elementary school students. 

The Comparison Sample , In trying to assess the effectiveness of CE it 
would be desirable to be able to compare the achievements of CE students 
with other similar students who were not receiving CE., We were able to 
locate 29 schools situated in high poverty areas that were not receiving 
-CS funds. These fora the Comparison Sample. 

The Nominated Sample . Because one of the major purposes of the Sustain- 
ing Effects Study was to determine the effects of Title I, it was 
essential that the total' sample of students contain a large number' of 
Title I students. Another purpose of the study was to determine those 
teaching practices which seemed particularly effective. Thus a Nominated 
Sample was fomed which consisted of 43 Title Z schools that were thought 
by state departments of education, the U.S. Office of Education, and 
other agencies, to be particularly good examples of effective CE 
practices . 
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In the first year of the study there wore 329 participating schools having 
about 120,000 students. ,\s will be described later, data were obtained on why 
students in each school) thus there are data on regular students, Title I 
students, students receiving other CE , affluent students and poor students, 
high-achieving and low-achieving students, students with different racial 
backgrounds and, in short, all the different kinds of students that exist in 
the nation's elementary schools. (There were some exclusions; excluded were 
schools with instruction largely for handicapped students, students in 
bilingual programs, students in Snglish-as-a-3eqond-Language programs, etc. 
These exclusions are described in Report 41.) 

Originally it was planned to continue the study with all 329 schools through- 
out the three years of data collection. However the full funding of the 
project was not available during the second operational year of the study, 
which resulted in a reduction in the size of the Representative Sample. 
During the. first operational year we were able to collect all of the data 
needed to make the national projections required by the Participation Study. 
Since the analytical methods involved in the Longitudinal Study do not depend 
on strict representation, but rather on maximum variation in the variables, 
being studied, it was decided to drop some schools, from the Representative 
Sample and retain the other samples intact. Even though the Representative 
Sample was reduced by _60 percent it _still_ remained_ a remarkably representative 
sample. Of the 120,000 students in the first operational year, about 70,000 
remained in the study during the second year. Readers interested in the 
technical details of the sample should refer to Reports 1 and 13. 

THE DATA COLLECTED AND INSTRUMENTS USED 

To undertake a study as diverse as the Sustaining Effects Study it was 
necessary to collect information about the students, the kinds of instruction 
they received, their teachers, their school principal's philosophy of instruc- 
tion and administrative practices, and descriptive material regarding the 
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school district. Table II-l Uat a the major Instruments u,ed La the Longi- 
tudinal Study, what was described by each instrument, the person completing 
it, the' frequency of administration and the month during the school year in 
which it was completed. Most of the instruments used are compiled in Report 
9A and the psychometric properties of the instruments are given in Report 9. 

Each fall and spring students completed three instruments: The Comprehensive 
Tests of Basic Skills, a Practical Achievement Scale, and a Student Affective 
Measure. The Comprehensive Tests of Basic Skills were administered to 
determine the students' achievement: in reading and math. 

The-e has been considerable criticism of standard achievement tests. It is 
sometimes claimed that they are biased against minority or poor students and 
also that they tend to measure academic subjects that are unrelated to real 
life situations. In an attempt to overcome the criticism of the academic 
nature of achievement tests, we developed a 'functional literacy' test, that 
oresented oictorially a number of situations that children commonly encounter 
in their everyday lives . While viewing each picture, students were asked 
questions about the situations pictured. This test involved both reading 
and math oroblems set in the context of practical situations. It was admin-- 
istered to all fourth-, fifth-, and sixth-grade students. Each student also 
competed a measure of attitudes toward school and toward reading and math. 
It turned out that the scales of this instrument were so- highly interrelated 
that it was sensible to use only the total scale score. 

Once a year the teachers filled out a questionnaire. The first part of the 

, , - _ j Aw^^ya -* n „ a „^ ~ono~aj ' n f o rma tio n . A secend part 
questionnaire asked ror demcgrapnic an- 3 en — . 

was for reading or math and asked about, instruction in that subject area, 
how students.. -ere grouped, how lesson plans were used, how instructional 
materials were used, what instructional methods were used, etc. Similarly, 
each principal reported on a set of demographic questions, as well as upon 
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Principal Questionnaire, 
Section D 


School 


Principal 


1 


February 


District Characteristics 

vUl w Li. uinittl l u iJLU.Li.un n 


District 


Suoerintendent 


1 


February 


District Ctiaracteristios 
Questionnaire, Section B 


Title I Program 


Superintendent 


1 


February 


District Expenditure Infor- 
mation Questionnaire 


District/School 


Business Manager 


1 


February 



jjy£ *0ct/Nov for the first year of data collection. 
DO 



hia or har philosophy of Instruction, att.Uuda toward diycLpltniH, «c:orb» at: 
coordination on instruction, and similar U.oinM , Th* principals d'Ui.-:rih.M 
thoir gchaolg in tarma or: ai;',a, grade rango, saiircea at: funding, c.l.viti a resign- 
manb practices, parent participation, and uharr; training, Likawiso, thn 
district superintendent and the buainooa manager completed quntitiamuiirou 
describing district instructional policies and expenditures, 

Two vary , important instruments ware the Compensatory Education Ron tar and tho 
Student Participation and Attendance Record, At each school the Local 
Coordinator completed the Compensatory Education Roster; by indicating for 
each student whether or not the student was designated to receive C£ funded 
by Title X or other federal funds, by state funds, and/or by district or pri- 
vate funds. This roster was important because it allowed us to classify 
students in terms of. their CS status.. A Student Participation and Attendance 
Record was filled out by each student's teacher, for reading .and for math; it 
reported the number of hours of instruction the student received in reading or 
math during a 'typical' week. The teacher also reported on the size pf the 
instructional group and the person giving the instruction (regular teacher, 
special instructor, aide, tutor, etc.). 

The Student Background Checklist gives information on such items as age, sex, 
race, previous education, grade, parent's education , ( parent 1 s participation 
in school activities, student's participation in school lunch programs/ and 
receipt of special services*' The Summer Activities Slipsheet obtained k info rma 
tion from the student -on activities during the previous summer, such as 
whether or not the student went to summer school, to camp, took a trip, etc . 
'it also inquired about reading activities during the summer . Interested 
readers should refer to SSS Reports 9 and 9 A "for the psychometric character- 
istics and exact items contained in each of' the instruments described above. 



68 



Data Collection . Because the amount of data to be collected was large and 
the amount of time involved was long, special steps were taken to assure that 
quality data would be obtained- As soon as a school agreed to participate 
the principal was asked to appoint a Local Coordinator who would be paid by 
SDC for his or her services. Frequently the principal acted as the Local 
Coordinator but at other schools the Local Coordinator might be the Title I 
director, the curriculum coordinator, or some other staff member. During the 
summer of each year a training program for Local Coordinators was held which 
included instruction on the procedures required in filling out the forms, 
administering tests, maintaining confidentiality, securing cooperation of 
the teachers, returning material to SDC, and similar matters. 

Special steps were taken to assure confidentiality. Number-name identification 
rosters were retained at the school so SDC had no record of the names of any 
of the students in the study. Because of these efforts to maintain' confiden- 
tiality, particular attention was paid to the maintenance of the linkage 
numbers for each student from year to year and also to link the students 1 
numbers with their teachers 1 numbers. 

Data Collection in High-Poverty Schools . It is often argued that information 
from formal tests, questionnaires , -and standardized forms do not give a real 
understanding, of the capabilities of students or of the school or institu- 
tional settings. Certainly the more intimate details of classroom instruction 
are not captured. In an attempt to overcome this problem/ 1 in-depth' data 
were collected at 55 high-poverty schools. High-poverty schools were sought 
because they had the highest concent l\ ' ons of CE students , the students with 
whom the Study was most concerned. 'I;'- ■ 46 of two observers visited the 55 
schools twice. The purpose of the first visit was to become acquainted with 
the school organization, and to have, a preliminary meeting with the teachers 
whose classrooms would be observed. The second visit lasted for cwo weeks 
and involved the collection o^'inf ernation in a number of areas including 
instructional practices in the second and fifth grades* At each school a 
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lengthy interview was conducted with the principal and each of the involved 
teachers. Classrooms were visited and the way in which instruction was 
conducted was noted. The teaching techniques used were recorded. Period- 
ically a count was made of the number of students exhibiting on-task behavior. 
Much of the material was recorded on prepared forms, but lengthy narrative 
descriptions were also recorded on audio tape. The data collected by the 
in-'depth techniques were combined with the more traditional data that had 
been collected for the Longitudinal Study and the results are reported in 
Technical Report 15. 

THE SUSTAINING EFFECTS STUDY REPORT SERIES 

The detailed', results of the Sustaining Effects Study are contained in a 
series of reports. These reports contain tables giving very extensive 
details about all of the data collected' during the study from thousands of 
students in 329 elementary schools. In addition to the detailed data, the 
reports include the results of various statistical analyses. The report 
series is made up of the following volumes: 

Report Number 

1. "The Sample for the Sustaining Effects Study and Pro j ections of 
its Characteristics to the National Population" by Eoepfner, R-, 
Zagorski, H., and Well'isch, J. # 

2. "Students 1 Economic and ' Educational Status and Selection for Com- 
pensatory Education" by Breglio, V. J., Hinckley, R. H,, and 
Seal, R. S. 

3. "Student Economic and Educational Status and Receipt of Com- 
pensatory Education " by Hinckley, R. H., Seal, R- S., and 
Breglio, V. J. 

4. "Student Heme Environment, Educational Achievement and Com- 
pensatory Education" by Hinckley, R. H. (Editor) . ' 

5. "The Nature and Recipients of Compensatory Education" by 
Wang, M. , Hoepfner, R. , Zagorski, H. , Henenvay , J. A. , 
Brown, D. S., and Bear, M. 3. 




6. "Resource Analysis of Compensatory Education" by Haggert, S.A., 
.Klibanoff, L.S., Sumner, G.C,, and Williams, R.S. 

7. "An Analysis of the Cost and Effectiveness of Compensatory 
Education" by Sumner, G.C., Klibanoff, L.S., and Haggert, S.A. 

8. "Summer Growth and the Effectiveness of Summer School" by 
Klinanoff, L.S., and Haggart, S.A. 

9. "The Measures and Variables in the Sustaining Effects Study" 
by Hemenway, J. A., Wang, M., Kenoyer, C.E., Hoepfner, R., 
Bear, M.B., and Smith G. 

9a. "A Compilation of the SES Instruments" by the SES Project Staff. 

10. "Compensatory Services and Educational Development in the School 
Year" by Wang, M. , Bear, M.3., Conklin, J.E., and Hoepfer, R. 

11. "The Effects of Discontinuing Compensatory-Education Services" - 
by Kenoyer, C.E., Cooper, D.M., Saxton, D.E., and Hoepfner, R. 

*12. "Does Compensatory Education Marrow the Achievement Gap" by 
. Zagorski, H . , Conklin, J.E., Cooper, D.M., Hoepfner, R . , and 
Wang, M. 

13. "Substudies on Allocation and Targeting of Funds and Services, 
Assessment of Student Growth, and Effects of Attrition" by 
Hoepfner, R. (Editor). 

*14. "Achievement Growth as a Result of Grade and Length of Participat 
in Compensatory Programs" by Rogers, M.S. , Landers, K.L., and 
Hoepfner, R- 

15. (No report with this number was prepared.) 

*16. "Successful Practices in High-Poverty Schools" by Lee, D.R., 
Carriere, R.A., McQueen , A. H. , Poyner, L.H., and Rogers, M.S. 

*17 . "Sustained Effects of Previous Compensatory Education on Students 
in Junior High Grades" by Saxton, D.E., Geddes , C.L., and 
Hoepfner, R. 

*18. "A Description of Compensatory Services in High-Poverty Schools" 
by Poynor, L.H., Surace, E.M., and Lee, D.R. 



* A draft of these reports was prepared, and in some cases typeset, but 
sufficient funds were not made available for them to be published. 
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19. (No' report with this number was prepared.) 

*20. "Background, Schooling , . and Achievement" by Won, E.Y.T., 3ear, M.3 
and Koepfner, R. 

*21. "A Study of Compensatory and Elementary Education: The Sustaining 
Effects Study. Final Report" by Carter, L*F. 



* A draft of these reports was prepared, and in sorr.e cases tyceset, 
but sufficient funds were not made available for them to be" oublished. 
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CHAPTER III. WHAT IS CC1PENSAT0R'/ EDUCATION? 



Summary 

To describe Compensatory Education we contrasted the instructional 
services received by CE students with those received by regular students 
in the same schools. • It is clear that there are important differences 
in the services received by these two groups of students. Sor.e of the 
imvortant differences are: 

# Title I students receive ser^Jices costing about $456 -ore than 
the services regular students receive. Most of this money ^s 

■ spent on teachers , remedial specialists and aides, 

# Title I students receive considerably more instruction in 
reading and math than do regular students. But while the Tizle 
I students are receiving this additional reading and math 
instruction the regular students are also receiving instruction 
of some type. Thus it is not clear that Title I students enjoy 
a net gain in total instruction. 

0 Title I students, receive much of their instruction from 

teachers who have had somewhat less teaching experience than 
regular teachers. However j the special teachers have had 
somewhat more coursework and inservice training in teaching 
methods than regular teachers. 

# Title I students receive ' their instruction in somewhat smaller 
classes than regular students. 

+ The major difference between Title I instruction and regular 
instruction is that Title I students receive less of their 
instruction in targe groups in regular classrooms and receive 
much more instruction in- small group settings from special 
teachers and aides. 

# The typical mode of special CE instruction is in a pullout 
setting. The pullout setting seems to offer a positive learning 
environment and rates very favorably when compared to other 
instructional settings . 

# Teachers of Title I students report using different methods 
and practices in teaching Title I students than do the. teachers 
of regular students. In reading, Title I students are exposed, 
throughout their elementary grades, to more elementary or basic 
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reading methods than are regular students j who receive information 
in more complex materials. In the firs* two grades the avor caches 

■ used in teaching reading eve similar., for Title I and regular 
students j but then they begin to diverge. By the sixth grade the 
approaches most frequently used with Title I students are least 

■ frequently used with regular students and vice versa. 

0 Teachers of Title I students report a much higher use of audio- 
visual equipment in their instruction than do teachers of regular 
students . 

INTRODUCTION 

There is no simple explanation or description of CI; it is an. amalgam of mar.y 
different programs, practices, and services- In the Sustaining Effects Study 
we have two main sources of information about what constitutes C2« First, we 
•have information gained from questionnaires completed by teachers, principals, 
and district personnel. From this survey material we can determine what 
services regular and CE students are reported to receive. Second, we conducted 
an in-depth study of 55 poverty schools. At these schools we visited class- 
rooms and observed the instruction being given to regular and CZ students. We 
talked t& the teachers and principals about what, their programs included. From 
these site -visits we have detailed descriptive narratives of CE programs. In 
this Final Report we'are including only two short descriptions to give a flavor 
of the variety of CS programs in different: schools. 

School A 

Three discrete . Title I program components serve identified students in this 
fairly large, 63-year-old urban school. The kindergarten program, which will 
not be described here, serves 48 students. The primary grades' Title I 
Reading Program serves 144 students in grades 1-3, while the Computer-Assisted'. 
Instruction (CAI) Lab serves 265 students in" grades 4-6 in both reading and 
math. 
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The .three primary grades' Title I reading teachers share a single huge room, 
where each is scheduled to see six groups of eight students for daily 50- 
minute sessions. Each has responsibility for teaching students from a single 
grade, but their teaching procedures are generally the same. Early in the 
fall, a diagnostic test is administered to each pupil. A needs-assessment 
sheet profiling the student's strengths- and weaknesses is developed based on 
the results of the diagnostic test. On the basis of the needs-assessment 
profile, the teacher develops a separate prescriptive educational plan for 
each child, outlining the sequence of skills to be attacked and materials to 
be used by the student. 

Students leave their homeroom classrooms to attend Title I reading instruction 
Upon arrival at the Title . I room, students pick up their work folders, which 
contain assignments for the week, and start to work independently, calling on 
their teachers when they need help. The teachers also provide some small- 
group 'instruction daily , usually to subgroups of three to four students who 
have common instructional needs. Skill profiles are kept up to date as 
prescriptions are completed, and the diagnostic test is readministered period- 
ically. The Title I room is well supplied with a wide variety of high- 
technology equipment and materials that are called into play in the various 
prescriptions. Heavy use is made of controlled readers, feedback teaching 
machines, audio tapes, filmstrips, records, instructional kits, and a variety 
of texts, workbooks, worksheets, and dittos. 

The CAT l>b is staffed by one teacher and one aide who oversee students 1 
progress on the 14 teletype terminals in the }.ab. The terminals are connected 
to a minicomputer, housed in the school, wh±£h serves a number of other 
schools as .well. The provider of the CAI software also provides a curriculum 
guide, specifying for various levels of performance on the CT3S where students 
should start in the math and reading curricula. The curricula cover 14 levels 
of difficulty, depending upon the students 1 grade levels, entry skills, and 
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progress. The software also provides a "time-out" feature, whereby repeated 
slow responding is quickly brought to the attention of the teacher. This was 
perceived to be very valuable for .keeping the students consistently on-task. 

The teacher and aide monitor student work and provide assistance with either 
content or machinery as needed by the students. The teacher or the aide 
reviews the summary printed out on the teletype at the end of each student's 
daily, approximately 20-minute session. A student who has achieved 100 
percent correct on the day's drill in either subject receives a colorful 
ribbon award to wsiir back to the regular classroom. This is called "The 100 
Percent Club." When the teacher decides that one or cnore pupils need 
additional instruction, help is provided in one of several ways. In most 
cases, the teacher or the aide will work individually with students while 
they are at the terminals. In some cases, if there are several students 
having trouble with a particular skill, the lab teacher will take a small 
group into the adjoining room, which is equipped with a chalkboard and 
several chairs, and will provide small-group instruction on that skill. Cn 
occasion, the CAI Lab teacher will also go into the regular classroom during 
regular^math instruction to give a special lesson to an individual or to a 
group . 

School 3 

The Title I program serving grades 1-3 in this small rural school consists 
basically of two full-time aides who provide tutorial and small-group instruc- 
tion. One aide, who has had one year of college, works primarily with secondh- 
and third-grace students in reading and math, and occasionally in spelling and 
penmanship. Due to overcrowding in the school, she is forced to .use" about the 
last 20 feet at the end of a hallway as her clajsreonu The second aide is 
a former teacher who has been a Title I teacher's aide at the. school for 15. 
years. She meets with students from grades 1-3, variously for reading, math , 
spelling, social studies, and penmanship, in a combined of f ice/kitchen/music 
lounge room. 
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There is fluctuation during the. year in terms of which students see the aides 
for supplemental instruction. Regular teachers send students in need to the 
aides, with- a priority being given to those judged to be most needy. One of 
the aides estimated that she had served 43 students for at least six weeks, 
11 of whom she had worked with for the entire year. Students who are seen on 
a regular and long-term basis tend to be those who generally have difficulty 
understanding new concepts as they are introduced in the regular classroom, 
and thus are behind the other children. Other students are sent on an as- 
needed basis, when their regular classroom teacher sees that they are having 
difficulty with a particular new concept or skill. In such cases, they may 
go to the aide for a few days or a few weeks. Still other children are sent 
to the aides long enough to catch up on work they have missed during absences 
from school. For students who attend regularly, the scheduled number of 
sessions weekly and the duration of those sessions varies from pupil to 
pupil or from small group to small group. Some students see an aide daily, 
while others go only once a week, in sessions ranging t from 15 to 45 minutes. 
The aides work with a maximum of five students in a group, and usually with 
only one or two students at a time. 

the regular classroom teachers generally tell the aides fairly specifically 
what skills need work by their students, with the aides having more or less- 
latitude in selecting the materials and approach to be used depending upon 
their relationships with the particular teachers involved. During the 
1978-79 school year, no Title I -funded equipment or materials were received 
at this school, but audiovisual equipment and instructional kits received in 
previous years are available for use by any teachers in the school. In part 
because of their distance from the equipment locations, the aides tend not 
to use -any of the equipment, and generally base their work on whatever texts, 
workbooks, or worksheets are being used in the regular classroom." 
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The two Title I programs described here are in marked contrast, but even more 
extreme pictures could have been chosen to highlight the differences in inten- 
sity and content of the instruction received by students, all of whom are 
labeled Title I students . 

Report 13 contains a number of additional descriptions of CE programs. They 
were selected to illustrate the settings in which instruction takes place, 
the kins of lesson material used, and the methods used to manage classroom 
instruction. Survey techniques tend to lump together studer. ts receiving 
cuite different services, but in terms of the national program, survey data 
can give a good summary of the Title I CZ program. The material that follows 
is an amalgam of the information collected by questionnaires completed by the 
district staff, school principals, and teachers, and reported in detail in 
Report 5 . The more qualitative material collected by visiting classrooms and 
interviewing principals and teachers in high poverty schools is given in 
Report 13. 

COMPENSATORY EDUCATION FUNDS — HCW MUCH MONEY IS THERE AND ON WHAT 15 IT SPENT? 

There are many different sources of CE funds; there is money from local, state 
and federal sources. The^ amount of these funds varies widely from district to 
district and, within a given district," schools vary considerably in the amount 
and kind of funds they have available- Title I is the largest single source 
of CE funding, and we will. examine Title I in detail throughout this chapter. 

We asked the business managers of the school districts to describe the amount 
of Title I funds that was spent for various kinds of services during v.he 1975- 
77 school year. Table III-l shows the different services on which Title I 
rands are spent for reading, math, and ' common services not associated with 
either subject.. It will be seen that the largest amounts are spent on 
teachers, curriculum specialists, teaching assistants and aides. Smaller, 
but in the aggregate, significant amounts, are spent on planning and evaluation 
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Table III-l 
Per-Pupil Expenditures of Title I Funds* 





Reading 


Math- . Common Costs 


Teachers 


$237 


$223 


Remedial and Curriculum Specialist, 
Teaching Assistants and Aides 


181 . 


* 

109 


Training of Instructional and Non- 
Instructional Staff. 


• 11 


16 


Administrative Services, Planning, 
Evaluation 


30 


37 


Instructional Supplies (texts, AV aids, 
supplies) 


26 


21 


New Equipment, Building Alterations , etc. 


47 


42 


Staff and Materials for School PAC, PTA, 
etc. 




$22 


Other Costs** 




94 


♦Columns cannot be added since different schools have 


different mixes of 


services. 






**Other costs include guidance, counseling, 


health and 


nutritional services. 



Source: Report 9, Table 8-31 



supplies, and equipment. Important amounts are spent on parent advisory 
groups, parent-teacher associations, and the like. Also, funds go to 
guidance, counseling, health and nutritional services. While these figures 
cannot be added to find the expenditures per pupil, since different schools 
have different mixes of services, they represent significant supplementation 
to the regular school expenditures. For the schools in the SES sample, the 
average annual per-pupil regular expenditure in 1976-77 was $1,139, and the 
average additional Title I per-pupil expenditure was about $436 for Title I 
students. The exact amounts for per-pupil expenditures are difficult to 
obtain because of different ways of counting the number of students receiving 
various services. However, these figures do give an indication of the 
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relative degree to which Title I students receive services over and beyond 
those given to regular students. .The $436 Tide I dollars pay for the variou 
services that will be described throughout this chapter. There can be no 
doubt that Title- I students receive instructional services different from 
those received by regular students. 

How are these special funds used? In the 55 high poverty schools we observed 
1,257 instructional groups. Of these groups, 45 percent were regular instruc- 
tional groups and thus received no special services, 30 percent received ser- 
vices paid for by Title I funds and ocher-CE funds. The remaining 15 percent 
were paid by other CE funds or funds from special sources. Thus, we see that 
in high-poverty schools over half of ail instructional groups have services 
paid for by other than regular school district funds, with Title I funds con- 
tributing the largest source of outside funding. 

WHO TEACHES TITLE I AND REGULAR STUDENTS 

Table III-2 shows a number of characteristics associated with teachers in 
various classroom settings. In our total sample of schools about a tenth of 
the teachers were in non-CE schools. Among the reading teachers in CE 
schools 17 percent teach only CE students, 60 percent teach both CE and non- 
CE students, and 23 percent teach non-CE students. The corresponding figures 
for math teachers are 11 percent, 43 percent, and 46 percent. Thus, we see 
that in. reading in CE schools most teachers teach both CE and non-CE students 
while roughly a fifth teach only CE students and another fifth teach only 
regular students. In math the situation is scmewhat different. ' There are 
somewhat fewer math teachers in CE schools who teach only CE students, but 
there is a considerably higher percentage of mach teachers who teach only 
non-CE students. • 
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Table III-2 
Average Experience and Training of Teachers 





Teachinci 
Only CE 
Students 


Teaching 
Both CE 
and Non-CE 
Students 


Teaching 
Only Non— CE 
Students in 

CE School 


Teaching 
Only Non-CE 
Students in 
Non-CE School 


Reading 










Percentage of Teachers Who 
Were: 


15 


54 


21 


— \ 

11 


Percentage of Teachers in CE 
Schools Who Were: 


17 


60 


23 




Number of Years Teaching in 
Any School 


10.3 


11.2 


11.0 


11.9 


Number of Years Teaching in 
Current School 


6.1 


6.8 


6.6 


6.6 


Highest Earned College Degree* 


2.6 


2.4 


2.5 


2.5 


NumDer or L.oxJ»ege courses in 
Teaching Reading 


1.9 


1.3 


1.1 


1.2 


Number or Hours or inservice 
Reading Training 


14.3 


12.0 


10.2 


10.9 . 


Math 










Percentage of Teachers Who 
Were: 


10 


38 


40 


12 


Percentage of Teachers In CE 
Schools Who Were: 


' 11 


43 


46 




Number of Years Teaching in 
Any School 


9.3 


10.8 


11.5 


11.9 ' 


Number of Years Teaching In 
Current School 


5.8 


6.6 


7.1 


6.7 


Highest Earned College Degree 


2.5 


2.4 


2.5 


2.5 


Number of College Courses in 
Teaching Math 


• .9 


.7 


.5 


.6 


Number of Hours of Inservice 
Math Training , 


8.2 


9.0 


5.5 


6.9 



*1 = less than 4 years of college, 2 = bachelor ! s degree, 3 * 5-year prepar- 
ation, master's degree, or 6 years specialist degree,^ ~ doctor's degree. 

Source: Special tabulation done for final report* 
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Forebqth reading and math, ::hose caacheri- who teach only CE students /nave 
had less total teaching experience and less caachir.g experience at tneir 
current schools. However, those who teach only CE students have slightly 
more college education, have more college courses in teaching, and somewhat 
more inservice training than other teachers. Presumably such training shoul 
maJc^ these teachers more effective. On ( the other hand, the regular teachers 
have had more teaching experience, which should make them more effective. I 
Report 1,0 the one teacher characteristic that seems to have been associated 
with greater student achievement, was the amount of teachir. .; experier.de of th 
teacher. Thus, to th'e extent that Title I students are receiving their 
instruction from less experienced teachers — and our evidence suggests this i 
the case — they may be at some . disadvantage relative to regular students. 

COMPENSATORY" EDUCATION INSTRUCTIONAL SERVICES 

What are CE instructional services? In the elementary grades they are large 
reading and math instruction. Thus, much of this chapter will be devoted to 
comparing the amount and' kind of instruction received by regular and CE 
students in reading and math. The school setting in which CE instruction is 
given varies significantly from school to school. Cur approach, to defining 
CE is to determine what services CE ' students receive in contrast to those 
received by regular students. Thus, throughout this chapter w£ will be 
comparing the amount of instruction CE students received with that received 
by regular students; we will compare the kinds of teachers instructing CE 
students with those , instructing regular students; and we will contrast the 
instructional approach and techniques applied to CE students with those 
applied to regular students.. 

The number of hours in the school day is almost always fixed, with CE stucer 
and regular students in a school attending a similar number of hours', but tr 
amount of instruction CE students receive in reading and math is different 
from the amount of instruction received by regular students. Figure .111-1 

1 
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TITLE I 
STUDENTS 



STUOENTS 
NON-CE 
SCHOOLS 



REGULAR 
STUDENTS 
IN TITLE I 
| SCHOOLS 



GRADE 



Figure III-l 

Hours Per Week Devoted to Reading Instruction for Title I and 
Regular Students in Title I Schools and Non-CE Schools 
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shows: the number of hours of reading instruction received by three groups of 
students: Title I students, regular students in the same schools, and 
students in-' schools that do not have any CZ students. The figure shews that 
in the first and second grades Title I students and regular students in Title 
I schools receive essentially the same amount of reading instruction. However 
students in schools not having C£ programs (schools probably being in more 
affluent attendance areas and having somewhat higher-achieving students! , 
even in the first and second grades are receiving, and presumably need,, fewer 
hours of reading instruction. Starting in the third grade and continuing 
through the si:<th grade, Title I students receive much more reading instruc- 
tion than regular students in either Title I or non-CZ schools* 

Since Title I students spend more of their time on reading instruction than 
regular students; are the CZ students missing out on other instruction? 
Figure III-2 shows the amount of reading-related activities received by Title 
I and regular students* .'Reading-related activities' are in addition to reguia 
reading and include spelling , vocabulary study, grammar, "and writing. It 
seems that the Title I students- spend a little less time in reading-related 
activities than -regular students, but the di .; ; > ;ence is only about a tenth of 
an hour a week while the difference in readin;:; instruction is as much as 1*3 
hours per week. 

We asked reading teachers, "When students are participating in compensatory 
reading activities, in what types of activities are their non-participant 
peers involved?" Teachers were asked to check all items that applied. The 
response from grade to grace tended to be quite similar. A majority checked 
other reading activities, 30 percent checked math activities, about 45 percent 
checked activities related to other subject matter areas, about 30 percent 
checked "study time," and about 25 percent checked "student • selectee activitie 
About 15 percent checked "visits to the library," about 5 percent indicated 
physical education activities, and about 2 percent checked "field trips." 
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Hours Per Week Spent on Heading-Related Activities by Title I 
Students and Regular Students in Title I Schools 
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These results are .confirmed by similar responses given by teachers in the 
high-poverty schools. The teachers were as!-:ed, "When any of your students 
receive compensatory reading/math instruction, what subjects are your non- 
compensatory students usually studying?" Table III-3 shows the results- 
Again, it will be seen that while the CZ students are receiving reading 
instruction their regular classmates are usually receiving reading or reading- 
related instruction. As will be seen later the ZZ students are receving 
reading instruction of a different character and in smaller croups with -ore 
individual attention* 

Table III-3 

Subjects Hissed by Compensatory Students While They Pjaceive 
Compensatory Reading Instruction 

Subject (s) Usually Bei^g Studied by Percent of 

Iten-Cocpen'-. tory Students 193 Teachers responding 

Regular reading or tsixed reading and 
language arts block 

Sav*:iriL subjects, including regular • 
3,. ding and/or regular rath 

Language arts 

Several subjezrts, other than rsgular 
reading or sath 

Secular math 

5c -'.ial studies. • } 

■Study period 

Subjects airsssd varied and were not 
specified ■ \ 

Ox v jcr (includes science, ,?£, penaknship, 
Spanish) 

Source. Report 13, Table 2-5. 
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Thus, while the CE students get more reading instruction, they are missing 
other instruction. Given the fixed length of the school day, this is almost 
inevitable and it means that regular students get more instruction in other 
subject areas than CE students. Reading is basic, and CE students need 
instruction in reading, but they pay a price for it in ter^is of other instruc- 
tion missed. 

Figure IIX-3 shows that Title I students receive much more instruction in 
math than do regular students. On. the average, regular students receive 
about 4-3 hours per week of math instruction while Title I students receive 
about 5.3 hours per week; the difference in favor of the Title I students 
starts in the first grade and continues through the sixth grade. In reading 
we saw a sharp decrease in hours of instruction as grade increased, but in - 
math this is not the case; °in math there' is a very slight tendency for hours 
of instruction to increase from the first to the fifth grade and then to drop 
in the sixth grade. Math teachers were also asked to indicate what the 
regular students did during the time when Title I students were receiving 
additional math instruction. The results are very similar to those reported . 
for reading. The regular students are involved in other math activities, 
reading activities, activities in other subjects, general study time, and 
sVud^nt-selected activities while the CE students are studying additional 
math. Similar results were obtained when teachers in the high~poverty 
schools were asked this same question. 

In summarizing the results for hours of instructional service, it is clear 
that CE students receive very significantly more hoars of reading and math 
instruction than do regular students. 3ut while the CE students receive this 
additional instruction regular students are often receiv: instruction in 
these and other subjects. Thus, CS students have a gross gain in reading and 
math instruction, but it is questionable whether they have a net instructional 
gain when the whole curriculum is considered. 
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Figure III-3 

Hours Per Week Devoted to Math Instruction for Title I Students 
' and .Regular " Students ..in Title I School arid Mon-C2 Schools 



CE students receive more hours of instruction" in reading and math than do 
regular students, but is it of the same or a different quality? One frequently 
suggested measure of quality is the size of the class in which instruction is 
given. 'Figure HI -4 shows the average class size by grade for Title I students 
and for regular students in Title I schools- It will be seen that for both 
reading and math the size of the class increases as grade increases. It is 
also apparent that classes exposed of Title I students are smaller. The 
differences are not large, but even a difference of one or two students should 
result in somewhat more individual attention for the CE students. At the 
elementary level much of the instruction in basic subjects is not given to 
the whole class but rather to smaller groups of students. Figure III-5 shows 
the way in *hich reading instruction is given in terms o>; the use of subgroups 
of the full class- In the first four grades almost all of the reading instruc- 
tion takes place in a subgroup setting and even in the fifth and 'sixth grade 
subgroup instruction is the predominant mode of instruction. The use of sub- 
groups characterizes instruction for both Title I students and regular stu- 
dents. There is sore, tendency for the use of subgroups "to decrease as grade 
increases, and there s a tendency for regular students to be more frequently 
in groups composed of students at similar levels of achievement than is the 
case with Title I students - 



A figure similar to Figure III-S for reading could be presented for math, bat 
the si:c lines cross so much that the figure would be more confusing than 
illuminating. The interested reader can refer to Table 4-17 in Report 5 for 
detailed figures- The general results are that grouping is used considerably 
less frequently for math than it is for reading. For Title I students math 
instruction is given in groups about ?C percent of the time while fc - re 
students the figure is about 60 percent. 
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Figure III-5 
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la summary it can he said that Title I students receive their instruction m 
somewhat smaller clauses than regular students. Much of the instruction in 
reading is given in subgroups rather than to the whole class. Tar math the 
situation is somewhat different with more of the instruction being whole-class 
instruction . 

IN WHAT INSTRUCTIONAL SETTINGS 'DO TITLE I AND REGULAR STUDENTS RECEIVE 
INSTRUCTION? 

As already indicated instruction can be given in many different settings. It 
can be given to the whole class in the regular classroom by the regular 
ceacher, or it can be given in small groups - by a special teacher, or in a 
special room by a special teacher, and any number of other combinations. Tour 
times a year teachers completed a Student Participation and Attendance Record 
which, . for each student/ gave us a report on the setting in which the student: 
received instruction. From this record we can compare the setting for Title I 
and regular students in Title I schools. Figure III-6 shows by grade, the 
hours of instruction for Title I and regular students, in the regular whole- 
classroom setting by the regular teacher. It will be seen that Title I stu- 
dents receive considerably less instruction in reading in this setting. 
Figure III-7 shows the same thing for math instruction with the same results. 
Figures I2I-8 and III-9 show the amount of. instruction in reading and math 
with the regular teacher when the class is broken down into smaller groups. 
For reading, both Title I and regular students 'receive about equal amounts of 
instruction in this setting, but for math, the Title I students receive con- 
siderably mere instruction from the regular teacher in. small groups than do 
the regular students- Figures III -10 and III-ll show the amount of reading 
and math instruction given by special teachers and aides (usually in a small 
group' setting) for Title I and regular students. It will be noted that the 
Title- I "students receive much more instruction in these settings than do 
regular rtudents. Finally, Figures 111-12 and 111-13 shew the amount of 
instruction where the student is working alone without the immediate assistance 
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Figure III-6 

Annual Hours of Reading Instruction Received by Title I and 
Regular Students From Regular Classroom Teachers in 
Student Groups of 14 o.r More in Title I Schools 
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Figure III- 7 

Annual Hour^ of Math Instruction Received by Title I 
and Regular Students From Regular Classrocrr Teachers 
in Student Groups of 14 or More in Title I Schools 
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Figure III-8 

Annual Hours of Reading Instruction. Received by Title 1 and 
Regular Students From Regular Classroom Teachers in 
Student Groups of 1-13 in Title I Schools 
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Annual -Hours of Math Instruction Received by Title I and 
Regular Students From i Regular- Classroom Teachers in 
Students- Groups of 1-13 in Title I Schools 
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Figure., II I- 10 

Annual Hours of Reading Instruction Received by Title I and 
Regular Students From Special Teachers and From Aides 
or Volunteers in Title I schools 
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Figure 111-12 

Annual Hours of Reading Instruction Received by Title I and Regular 
Students by Individual Seat Work in Title I Schools 
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of a teacher or aide. It will be noted that regular students engage in con- 
siderably more of -this kind of learning than do Title I students. This should 
be to the advantage of the Title I Students since they should learn more when 
being actively taught rather than when working by themselves. 

We have included so many graphs on this subject because we think it presents 
one of the most: important distinctions between Title I and regular instruction. 
It should be remembered that all of these students come from the same Tinle I 
schools. The graphs show clearly that in both reading and math Title I 
students receive less instruction from the regular teachers in whole-classracm 
settings and that Title I students spend much less tine working on their own 
with workbooks, dittoed sheets, etc. -But the most significant difference is 
that, in contrast to regular students, Title I students^recei ve much more 
instruction from special teachers and aides in small group settings. The 
Title I dollars largely go to buy this difference in instructional personnel 
and setting, a setting that should be favorable to learning. (In Chapter V 
we will see whether this is indeed the case.) 

The difference is further illuminated by our study of high-poverty schools. . 
In the high-poverty schools observers visited instructional groups and counted 
the number of .students present and the number of staff members giving instruc- 
tion. Table III-4 shows the number of students present in four different 
instructional settings: the regular classroom/ pullout instruction/ instruc- 
tion where additional staff assist the regular teacher, and self-contained 
classrooms (where students are given a special curriculum/ such as in Follow 
Through classrooms) . / 

The figures of major interest are those for regular instructional groups and 
those for pullout instructional groups , t since most compensatory education takes 
place in pullout groups. It will be seen that the pullout groups are two and 
a half times smaller than regular instructional groups and that each student 
'has almost three times as much staff time available as in a regular instruc- 
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Instructional Group /Size and Staff Tim»j for Each Stuc'.o:;t 

In Four Settings 



Regular Instruction 
Pullout Instruction 
In-Class Ins true tic n 
Self Contained Classroom 



Average Instructional 
Group Size 

18 
7 
20 
16 



Staff Minutes Per Hou: 
for Each Student 

5 
14 



Source: Report 18, Table 4-1 

tional group. In the other two settings the number of students and amount, of 
staff time are s imilar ~to~~ those "in" the regular "crass" room . K ere~ we~~s ee~~ t "ha t 
CE students receive much more intensive instruction than other students. 

In pullout settings, 40 percent of the groups were taught by a CE or special- 
ist teacher with special instructional materials or equipment and in another 
36 percent there was also a paraprof essional . In 11 percent of the groups 
there was only a paraprof essional . When the CE instruction was in the regular 
classrdom the resource, in addition to the regular teacher, was a paraprof es- 
sional 60 percent of the time and in another 20 percent a paraprof essional 
plus special materials or equipment. 



In addition to simple class size , the quality of instruction can be judged by 
the proportion of students who are actually involved in the instruction. 
Durinc each observation ceriod the observers noted .\* number cf students who 



a:tea: 



:c be 'off-task 1 , that is who were not ape .rently engaged in learning 
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activities. In addition thuy noted the apparent ..' ri or the 'or r-i:.i..:-; 1 
behavior. Table IV- 5 shows the amount; ot 'on-cask' behavior and 1 or r-car.k 1 
boha/ior as a function of instructional Hatting. 



Table III-5' 



'On-Task* Behavior and Instructional Sett 



ing 



Regular Instruction 
Pullout Instruction 
In-Class Instruction 
Self Contained Classroom 



Percent of Students 
'On-Task 1 

79 

B5 

75 

78 



Percent of Students 'Off-Task 
25% or more of Lesson Time 



19 
14 
22 
18 



Source: Report 18, Table 4-2 



It will be seen that there is somewhat more 'on-task' behavior among pullout 
groups than in other settings and that somewhat fewer of the students are 
'off-task 1 in the pullout setting. The observers noted the apparent reason 
for the 'off-task' behavior and reported that about 45 percent of it was self- 
initiated as evidenced by day-dreaming, leaving the instructional group, and 
similar activities, about "30 percent for ' the regular classrooms and about 20 
percent for the pullout 'off-task' behavior was caused by distractions from 
another student, about Id" percent by lack of assignment or unclear directions, 
about 5 percent by external disruptions and the remainder by miscellaneous 
sources. Again we see that the pullout instruction seems superior to regular 
instruction. 
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Roport 13 contain;; a number or: ouhor [i;o.:uiuro:.i or" aot.ivi tios t.ik iw- \ 1 n : - j i.n 
tho claanL-ootu and relates thosn to the :;ietti;\rj in which Ln ; ; lvm-:- v. i _r, i.u ».j Lv-t. , 
For: example in both regular and puilout irui ".ruction about 7 r j [lorjmi::, of the 
teachers' time is spent in actual instruction , about:. HO percunt: i;i anont in 
behavior management. Table 4-5 of Report 13 raportrj on classroom atmosphere 
as evidenced by such items as teachers making negative consents , efficiency of 
instruction, classroom tension/harmony , etc. These are reported in terms of 
the instructional setting. Generally the results tend to favor puilout 
instruction . 

Table 4-6 of Report 13 summarizes all of the observations made in different 
classroom settlings and attempts to determne the f avorableness of different 
classroom settings in terms" of "their presumed" positive" impact on learning. 
Th 96 of the 120 comparisons, puilout instruction ranks ahead of the other 
three instructional settings. It thus appears that the instructional setting 
in which most CE students receive their special instruction is one which 
should be conducive to learning. 

ARE THE TYPE AND CONTENT OF INSTRUCTION DIFFERENT FOR TITLE I AND RE Go LA?. 
STUDENTS? 

We have seen that the services given Title I and regular students differ in 
terms of total hours of instruction, size- of class, experience of the teachers, 
and the setting in which instruction is given. We will now examine the- in- 
structional practices used by teachers to see if the way instruction is given 
differs between Title I students and regular students in the sar.e schools. 

Teachers were asked a series of que scions about hew they cave instruction in 
reading and math. Teachers were asked, "To what: extent are the relieving 
aspects of your reading (or math) instruction basically the same fcr ail or 
most of your students?" They could answer "basically the same for most of 
the students" or . "tends to vary among students." Table III-6 shows the per- 
centages of students whose teachers reported that instruction varied in a 
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Piaraonf.a-jo or: Ticlu I atvi R'/kjuUw: ;.it:urliint;i.i La Titlo L ;!.:|yjr>l.i 
Who no TMachnr/;i report; Th.it: tru'itrur: rJ,nn VarLuv; Amnn«j St:u»lunt:.i 



Typo of Inn truer Ion : 

Total Tinw in Subject 

Instructional Objectives 

Sequence of Activities 

Expected Rate of Progress 

Teaching Method 

Types of Instructional 
Materials 

Content of Instruction: 



Based on Approved 
Curriculum 

Based on tested needs 
assessment 

Both approved curriculum 
and needs 



Titla I 
Sttudonta 

32 

62 

56 

91 

72 

68 



33 



19 



48 



Regular 
Students 

2 9 

5-1 

40 

92 

• 62 



43 



11 



46 



H:\ th 



b*4n_ I Regular 
S bud urTfetr *»> , v ,a^ S tudn n ft 

vV 



32 
50 
46 
09 
64 

56 



32 



22 



45 



23 
37 
3 4 
85 
54 

44 



46 



10 



43 



Source: Report 5, Tables 4-20 and 4-21. 



number of areas. In contrasting Title I students and regular students we see 
that there were a number of areas where instruction varied more for Title I 
students than for regular students: the amount of time scent in instruction 
tended to be more variable for Title I student-? ■ particularly in math; the 
instructional objectives tended to be more va.; .Die for Title I students; 
the sequence of activities was more variable, again particularly in math, as 
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Unto r:hn r.f t.JhUVi mu^l'-l-i uvl tiw.i r- y j - • • t i n-i 1 r\ . r.yjn .: i.on-'t .V ui.i l.i !..-. , : 1- ' : f • 
c. t .i/vc'h^.i."*. >' : both Tit.U» i: :ir.wi!'H\r.:-i h\v\ r.vj«jul..ir :*nuh}\\K:\ iiy t v*\-; •:.:«. 1 ; :i'.u l->n': 
to u|\ow w-[iu\,l, amount :i ^ vuiaU.nn Ln thols: r, : u:t.in o\: niroqrtui:; . In tia-m.i ,>r. 
Uho cnntont or; ins t: run U on LIv"»l-ij v/a *i nonnid«ir.\h.Lo vai: Lab I. L I r.y , Tlvro w-u< 
cjnnfiulnvabiv Lo n n umii or: apnrrovnd curriculum £ov Title I stud^nt^.i r.hajir for: , 
roc/uLw: Mtudonts, la tho caao oti Titlo C afcuilonc* fchoro vmj :aor;o fr-vriuont 
Lui.i'a;; a curriculum davi>;od in tornni of a to.iit-bafiod not2d;j-;i jn^iir.iiKint: m:.;>!:' 
than uao of a sr.andard approved curriculum. A;i gr:w J ,^ I n^ron.i/y.i ihor^ w-.ui i h 
loais U:;u or: tho approvod c;u::s;i^uUwn for pit Lis I ;■; :.udo:v .wi"! ;;iu:h - 
resort to instructional material baaed on a noodis-aajossworr: , Table III-o 
shows that there is a noticeably greater effort to individualize the typo and 
content of instruction 'for Title I students than there is for regular students 
Many believe this should be a positive factor leading to greater learning. 

ARE THE RE AD IMG AMD MATH ACTIVITIES C? TITLE I "STUDENTS DIFFERENT T RCM THCSE 
OF 'REGULAR STUDENTS? f 

As this chapter progresses we are examining in finer detail the activities that 
teachers use to instruct their students. It is the actual process of instruc- 
tion that det^raines the intellectual content or material that the student 
receives. Teachers were asked to describe the frequency with wnich they 
engaged in a variety of instructional activities - There were twelve different 
reading activities that the teachers described as being used "very frequently"" 
(scored 5) to "never or almost never" (scored 1) . 

A number of activities we^re used with great frequency in the first grade, but 
with progressively declining frequency at successive grades. These activities 
which tended to be used more frequently with Title I studer.es than with 
regular students, were: 

Identifying and practicing letter- sound correspondence 
Identifying and writing letters or groups of letters 
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Bu;uU,:vj r.::;<t:.rj orally 

TIujmo am .HU'tvuUa anfclvLtLoM aivl . : u:o r.-.n^.i si:uil*mtti t\t.\r\: wUh In t'h" fir.-jr. 
rjradn, wlvu-e. rtuHio /ictlvUl^i wmvu about; .1,3 on a civ^-L^ U\t rVMU*, 

WhUn Kivnu KV3t:.Lvl,t:t.«»M d.iovo.uin wUh qv ula r.hny a;;a :U«,1 11 uvM " -m.M-i m^'V in 

.;i.mi.Ur:Ly t\v.iv>A w.u a 'j::cup of v. i. 7 '.. »: bv, u.-..mI r- > 1 \r. i vnly i.af?:-vri.»ti*.:!.y m 
first grado, but U;s uaad incco.viml in Clio higho:: gradoa, Thns'i aouivi^-iois 
wore: 

Dividing words into syllable a 

Answering comprehension questions based on timed reading 

Using reference materials such as dictionaries and encyclopedias 

These are more complex activities than those- in the previous list. There is 
some. tendency for regular students to engage in these activities more fre- 
quently than Title I students, as might be expected since the regular students 
are achieving at a higher level. Finally there was a group of activities that: 
showed no changes with grade. The following two activities were engaged in 
frequently throughout the elementary grades :■ 

Using context clues to gain meaning 
Answering questions requiring comprehension 

The following activity was low in the first grade and then at the "sometimes" 
level in the remaining grades: 

Reading and writing stories created by self or other students 
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In y , <-\\< ■■■'■■> ti'i.aasr .in \ i r ::t:-.iti '. :< -a;... a: i ii:.: ! '.a 'a : «:hLa-; >-:a;. 

;.,.;:!.: t,.; ).-. s -.i.:.t.i ar.i us<> i very r re i<ua> >' !.y La thn L.wm!.- .-.iril.i:. i-.u«: .a,: n : . < • ■ '. 
.lootr«.«..,i ci:.« iu..rv.-y -ia -J^U, l .r....n«.i.-a ! a , liv,-uv.n- ( T L r.l.n [ .'aam-:, ... 
|\tjh.«i: <jf.-nliiM ainiUiniu ta> bu lMsiti-ucn.nl t!ir.m..|ii i:!v> «-4»« nc ba.-ii.-- ,a .'.••M' a, ; 
BMr «i than '1o reguUv snudenca, Maw qnwpl.Ln.Ht-.e.l la^inq P^'-^- !;i u " ; i 
Ucr^quonMy l.a kSw lower gr.u'.ea and mora fv"qu..nt!.y in ':iie hl-ji'.er ^'•'■'■''••la 
•I'lan-'.i ia a slight tutvlonoy rat: TIM.! X « tu l-m '.a « !" i:u.'..iau:'.o < In 
act:.v.V!.M-ai l.a i'j f radiantly civ in regular a ra v U> a a . 

;~\lnc.<\ Learning to road id such an Important part of a ahi.ll 1 :-, «deo •. >n , v.. 
gathered oxu.irnUvo data on coaci, -a' practice in teaching reading. Wo w.u. 
co aoo if teachers uaod different praoticea In teaching Title I atudunta fram 
those they used with regular atudents. Wo have juat soon chat there are 
significant differences in the acc.ivir.ion that are moat frequently used. We 
went further and attempted co nee within chose aacivities if there wore partic- 
ular approaches favored in teaching Title I children. For each approach 
teachers were asked to indicate whether the approach was "used as a major 
approach," which was scored 3; was "used as a secondary approach," and was 
scored 2; or was "not used," and scored 1. Lisced below are approaches chat 
increase with increasing grade and which are also used more frequently with 
Title I students. The approaches are listed in the order r f. che difference 
in their use for Title I and regular students, 

1. An approach that uses a modified alphabet system which either augments 
or marks 'the regular alphabet so that it corresponds more closely to 
the sounds of the language. 

2. A self- instructional approach that uses a series that presents 
material in 'frames 1 containing .small bits of information to which 
the children are" asked to respenc. I—.ediate cenf irr.aticn as to the 
correctness of their answers is given in the text. 
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3. An approach in which children select their own reading materials, 
such as library-tyre books, and receive ins traction primarily through 
teacher-child conferences. 

4. An approach that uses a reading series and/or library-type books to 
teach forms of literature and literary appreciation. 

5. An approach in which children read their own writings. These 'stories' 
provide the material on which reading instruction is based. 

e\ An approach that includes reading in the content fields, such as 

science and social studies; teaching of study skills, such as how to 
use tables of content, indices, graphs, dictionaries, encyclopedias, 
etc.; and instruction in how to organize materials into outlines, 
summaries, and reports. 

4 

There was only one approach that was used more frequently in the first few 
grades and was then used less frequently as grade increased. This approach 
was also one which was used by teachers of Title I students much less fre- 
quently than' with regular students.. 

7. An approach that uses a graded reading series containing a vocabulary 
based upon words that occur frequently in the language. New words 
are introduced by sight and by a phonic analysis presenting the 
letter-sound relationship of consonants before, that of vowels. 

These were two approaches that were used as frequently in the. higher grades as 
in the lower grades; these approaches were used significantly more frequently 
with Title I students than with regular students. 

8. An approach that uses a graded reading series containing a vocabulary 
based primarily upon words that are regularly spelled. The most com- 
mon patterns, those containing short: vowels, appear first, a typical 
sentence in an early reader being: Nat is a fat cat. Gradually, 
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more complicated, less frequent patterns are introduced. New words 
are learned by analysis of spelling patterns or by sounding and 
blending. 

An approach that uses a graded reading series containing vocabulary 
that rapidly introduces the letter-sound relationships of all the 
sounds in the language. Long and short vowels are introduced at the 
onset. New words are learned by sounding and blending. 
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Finally, approach 10, below, differed by having one trend for Title I stud 
and a different one for regular students. This approach was used with equal 
frequency for both groups in ■ the first grade, increased with frequency of use 
in the second grade, and for regular students continued to increase to the 
sixth grade. But with Title I students its use decreased after the second 
grade and was lower in the sixth grade than it had been in the first grade. 
10. An approach that uses a reading series and/or other books to teach 
both literal comprehension and understanding of implied meanings in 
the text. 

The previous results have been presented in terms of changes in frequency of 
use of the approaches as grade changes and iir terms of the size of the differ- 
ences in use with Title I and regular students. This presentation may give a 
wrong impression regarding the frequency of use of the various approaches. 
The frequency of use varies greatly from the first grade .to -the sixth. In 
the first grade the same approaches tend to be used with Title I student- 
with regular students, but the differences increase with grade.. The foiiow- 
ing list gives the rank order of the frequency of use of the approaches for 
Title I and regular students in the first grade. The approach listed firs- 
is the most-used approach while the last one is least used. (In the list the 
,umber is the one used in the text above . to identify the description of each 
approach while the short sentence is a capsuled statement of the major charac- 
teristics of the approach.) 
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Title I Students in the First Grade 



Regular S tudents in the First Grade 



Graded sight phonic analysis (7) 

Graded letter-sound relationships (9) 

Literal and implied comprehension ( 10) 

Graded spelling, sounding/blending (8) 

Literary forms and appreciation (4) 

Students read own writing (5) 

Modified alphabet (D 

Students select own materials (3) 

Reading in content fields (6) 

Self instruction with reinforcement (2) 



Graded sight phonic analysis (7) 
Literal and implied comprehension (10) 
Graded letter-sound relationships (9) 
Graded spelling , sounding/blending (3 ) 
Literary forms and appreciation ( 4) 
Students read own writing (5) 
Students select own materials (3) 
Self instruction with reinforcement (2 
Reading in content fields (6) 
Modified alphabet (1) 



In the list for the sixth grade the contrast between the approaches used for 
Title I students and regular students is striking. The first three approaches 
used with Title I students are the last three used with regular sixth grace 
students. The three most-used approaches with regular, students are the last 
three approaches used with Title I students. The most-used approaches used 
with regular students in the sixth grade are advanced approaches, that is, 
they assume a mastery of elementary reading and emphasize comprehension,, 
literary form, and content-field reading. The first three approaches with 
Title I students are different- Title I students who are having reading 
difficulty are exposed to approaches emphasizing modified alphabet, self 
instruction, and reading their own writing* And this is no fluke of the data. 
The list for the fifth grade is almost identical to that for the sixth grade, 
with the first three items for the fith grade being the same ones as for the 
sixth grade for both'Title I students and regular students. It seems that 
Title I students are much more frequently taught by special teachers and aides 
and are assigned to self -instruction and the reading of their own writing in 
the higher grades. 



In summarizing this material it is clear that both the activities engaged in 
and the approaches used vary considerably with grace. Some practices are usee 
more frequently as grade increases, others are used less frequently, and some 
retain about the same frequency. For many of the teaching practices there are 
clear differences in the activities and approaches used with Title 1 students 
and with regular students, and these differences vary with grace. 

For math the trends are not as strong as they are in reading. The activities 
that are used relatively frequently in the lower grades and less frequently 
in the higher graces are, in the order of their frequency cf use: 

Learning about number sentences 
Learning about sets 
Learning symbols 
Working with math games 
Working with physical models 

To those of us who have not directly observed the changes in elementary school 
curricula over the years, this may be a surprising list. 

The activities that are low in the first grades and increase as grade 
.increases are, again in order of most use: 

Reviewing computational skills 
Learning about number theory 
Learning about measurement 
Learning properti.es and axioms 



Activities wnicn ar* 



fiat and ordered from high to lew use art 



Learning about fundamental operations 

Learning math vocabulary. 

Learning geometric concepts 

Learning about structure of number systems 
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One final activity, solving word problems, starts with a low frequency in the 
first grade, increases through the second, third and fourth grades, and then 
decreases. There are small ^- di-f fe-renc-es-between-Ti tie I and regular students 
in terms of the activities used' in their math instruction, .Relative to 
regular students, Title I students receive more" "learning about the structure 
of number systems, " "working with math games," "working with physical models," 
and "learning about sets.'* 

DO TEACHERS USE MATERIALS AND EQUIPMENT DIFFERENTLY WITH TITLE I AMD REGULAR 
STUDENTS? 

In teaching reading and math, teachers use a number of different approaches. 
They all use some kinds of materials and equipment. Among the materials used 
by teachers are regular texts, supplemental readers, "free reading' books, 
reference books, workbooks/ dittos, programmed texts, games, puzzles, geo- 
boards, and many others. We compared the use of these materials for regular 
students and low achieving students and found some differences although all 
these materials were used with all kinds of students. There was a slightly 
lower use of texts with low-achieving students and a slightly larger use of 
programmed materials. Generally it seemed that the low-achieving students 
were given more instruction with materials in addition to the regular text. 
The same tendency was definitely the case with equipment such as sound pro- 
jectors, individual viewing ^equipment, tape recorders, listening centers, 
special reading machines/ study carrels, etc. Title I students receive more 
instruction through the use of equipment than do regular students as is shown 

in Figure 111-14. If such-use of equipment is effective Title I students 

f 

should certainly show achievement improvements. 
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SOURCE: REPORT 5. TABLE 4-37 




> READING 



MATH 



T1TXE I STUDENTS 
REGULAR STUDENTS 



•SCOPES ON THIS COMPOSITE WERE CREATHD 3Y SUMMING THE FREQUENCY PER MONTH 
OF USS OP VAR OUS PIECES OF EQUIPMENT; SCORES RANGED FROM Q — 160. 
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. Figure III-I4 

Use of Reading and Math Equipment by Title I and' 
Regular Students in Title I Schools. 
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What is compensatory education? There is no single thing that can be called 
compensatory education. It is a whole collection of things than are different 
in the education of Title I students than would hav e been the case if they had 
been regular, students. 

Our results show that there are clear and significant differences in the 
instruction received by Title I students and regular students. In Chapter V 
we will see whether there is evidence that these differences lead to greater 
achievement. 
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Chapter IV. ?7K0 RECEIVES COMPENSATORY EDUCATION? 



Based on economic data gathered by home interviews, and achievement data 
based on achievement tests, it was possible to determine the percentages 
and numbers of students receiving Title I and other CE services in terms 
of voverty and academic achievement classifications . The results shew 
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Among economically peer students 40 percent rece^vec ^ -j>r^2 
percent did not. ~ Among the non-poor students 21 percenz received 
CE while the remainder did not. 

Because there are many more non-poor students than poor students , 
the absolute number of non-poor ..students receiving CE is larger 
than the number of poor students- receiving CE. In 1376-77- there 
were about 1,230 ,000 poor students and 1,693,000 non-voor students 
receiving Title I. 

There were about 2,500,000 poor students who did not receive any CI 

Among low-achieving students 46 percent received CE while 54 per- 
cent did not. Among regular-achieving students 19 percent 
received CE. 

Because there are many more regular students than there are low- • 
achieving students, the absolute number of low-achieving students 
receiving CE is smaller than the number of regular-achieving ^ 
students receving CE. There were about 1,200,000 low-achieving 
students and 1,300,000 regular-achieving students receiving ■ 
Title I. 

About 2,000,000 law-achieving students did not receive any CE. 

Among students who were both poor and low achievers,' 40 percent 
received CE while 60 percent did not. Other ccrnparisons. show 
that there were significant numbers of non-poor, regular 
achievers who received -CE. 
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9 Relative to their mmbev in the total student peculation, zne 
studenzs most likely to receive CE services vere Hispanic and 
black, were in large cities and rural areas, and were in the 
West and Mi d -Atlantic regions (although if only Title I is con- 
sidered, the largest proportion were in the South). 

* Schools are selected for CE funds by a nurxbev of different 

criteria but the most frequently used are free or reduced-price 
lunch counts and/or AFDC enrollment. Within schools^, students 
are most frequently selected in terns of teachers ' judgments or 
test scores. 

0 Several tare e tine indexes are presented that measure z r \e e~ ~~- - 
ciency witn which schools select students for CI.' 



INTRODUCTION 

Title I of the Elementary and Secondary Education Act was first authorized 
and funded in 1965; by 1980 it was distributing over three billion dollars 
annually. Title I funds are received by all the state's and .by 96 percent of 
the nation's school .districts - ' As McLaughlin (21) points out, the original 
Title I authorization was supported by a nixed and powerful constituency. 
Those whose major concern was with poverty and ways of alleviating it believed t 
that the funds would go to poor schools and districts and thus directly help 
the poor. Those who were principally concerned with improving the education 
of low-achieving students felt that the funds would help such students and 
thus they supported the Title I program. It was assumed that there was a 
close relationship between poverty and low educational achievement. McLaughlin 
makes the point that: 

"Senator Robert Kennedy did not share the general euphoria that 
pervaded Washington when the 1965 Elementary and Secondary Education 
Act (ESEA) was ratified. ESZA was enacted with high hopes for 
benefiting disadvantaged children. Title I of that act, which 
targets more than $1 billion a year to 'meet the special educational 
needs of educationally deprived children, 1 was the particular ca.use 
of excitement and self -congratulation on the Hill. It had broken 
through the long- standing opposition to federal aid to education 
and was viewed as an effective way to 1 break the cycle of poverty. 1 
Lawmakers were confident in 1965 that schoolmen knew what to 'do 
with the added resources, and that they would thereby establish 
effective compensatory programs for pcor children. Title I was 
perceived as a central part of President Johnsons War on Poverty., 
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Reports f rem some of Senator Kennedy's constituents, however, coun- 
selled against such optimism. Ke concluded that seme schoolmen 
might not use the new Title I dollars in the best interest of poor 

children unless the act; included.. some.. way_...to._insJU_re_ th2iZ^hey_:dP\ild_ 

not be cheated of the special attention intended by the legislation . " 

Those who were mainly oriented toward poverty considerations were able to 
specify a funds-allocation formula that would assure that the money was 
spent in poor districts and schools. Funds are first allocated to states as 
a function of the number of poor families in the districts of the szaze , the 
number of mothers receiving assistance under Aid for Families with Dependent 
Children, the number of neglected and delinquent children in schools and 
institutions , and several other poverty-related considerations. Similar 
criteria are used by the states to allocate money to the school districts. 
3ased on the amount of money received, the districts select schools to 
receive money or resources depending on various poverty criteria. However, 
at the school level the criteria for allocating resources to students become 
clouded because of the need to consider what other resources the school is 
receiving, say from the Emergency School Aid Act, or from state programs. . . 
However, those concerned with poverty could be quite pleased that Title I 
funds were targeted toward the poor communities throughout the nation. 

There was, however, an important group that felt that the targets of Title 
I funds should be children with low educational achievement . After all, 
Title I was an educational program. Was the assumption that there was a high 
correlation between economic need and educational need really true? By 1974 
questions about this assumption had .enough force that Congress decided that 
there should be a study to determine the economic and educational status of 
students participating in Title I programs. In the Educational Amendments 
of 1974 Congress mandated the Participation Study, by saying: 

"In the case of programs and projects assisted under Title I of the 
Elementary and Secondary Education Act of 1965, the report under 
this subsection shall include a survey of how many of the children ■ 
counted under Section 103 (c) of such Act participate in such pro-- 
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>-ams and orojects, and how many of such children co not, ar.c 
survev of" how many educationally disadvantaged children partici- 
pate- in such programs and projects, ar.d how many ecucaticr.a— y 
disadvantaged children do not." 



While Congress specifically authorized a study focusing on Title Z students, 
Title I operates within a school environment with other compensatory education 
programs as well as the regular school program. The general idea is that 
compensatory education (CE) consists of instruction in addition to regular 
instruction. It is given to students who have received- the regular instruc-. 
tional program and are having trouble progressing at the expected rate. But 
.as soon as one moves from the general concept to specifics, troubles arise. 
How does one judge that a student is not progressing at the expected rate? ■ 
Also, there are many special programs in addition to the regular program. 
Which are the CS programs? There is Title I, Follow Through , English as a 
Second Language, Services to .Migratory Children, Services to Handicapped 
Children, the Emergency School Aid Act, Programs. for American Natives, 
special state programs, ■ special district programs, etc. Are all of these CE, 
and are the different activities funded under them properly called CE? "In 
Chapter -III 'we described the CE instructional program. For the purposes of 
this Chapter, CE is .defined as an- instructional program providing services 
that are different from, or in addition to, the services provided to regular 
students. While this definition seems straightforward, it has a number of 
difficulties when applied to individual students and programs. The interested 
reader may refer to Report 9 (p. 69 ff) for discussion of the problems we 
encountered when we tried to determine which students were CE students. 

In the Participation Study we were mainly concerned with the Title I Program 
but we also had to consider other programs. Frequently Title I students 
receive services from. several programs. Also, the nature of the Title I 
program in a school is affected by the other programs in the school . All of 
these considerations affected the design of the Participation Study. 
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THE DESIGN OF THE PARTICIPATION STUDY 

The basic idea: of the Participation Study was to determine the number of 
children in the nation 1 s elementary schools who were receiving Title I 
services and came from poor* families, and also how many children were from 
poor families and were not receiving Title I services. In other words we 
were to determine the relationship between receipt of Title I services and 
poverty status. 

Similarly, we were to determine the relationship between receipt: of Title I 
services and educational status. In the law authorizing the study, Congress 
defined poverty in the same terms as those used to determine poverty for the 
allocation of Title I funds. They also defined students, as being education- 
ally disadvantaged if they were one or more years below grade level. Thus, 
to undertake the study we had to do three things: 

1. Obtain a sample that was representative of the nation's children 

in elementary school. 
.2. Determine the poverty status of" the families from which the children 

came . 

3. Determine the educational status of each child in the sample. 
THE SAMPLE AND HOME INTERVIEWS 

To determine the poverty status of the children in the sample it was neces- 
sary to conduct a home interview with the parents of each student. Since home 
interviews are expensive, we had to balance expense against the desired 
accuracy of the national projections to be made as a result of the home inter- 
views. It was decided that a representative sample of 15,000 parents would 
be interviewed. It will" be remembered from Chapter II that one of the 
samples for the Longitudinal Study was a Representative Sample. This sample 
included 243 schools that were representative of the nation 1 s elementary 
schools. A .random sample of students was drawn from each of these schools. 
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Interviewers visited 'the parents of these 



students and asked a series o: 



i 



questions regarding the' economic status of -he. family, the atti cude of _tne_ _ 

parents' regarding their children's school and the education they were 
receiving, the amount of time the child spent doing homework, the extent of 
parental assistance with school work, the child's leisure activities, and 
"other educationally related questions. For a full discussion of the sampling 
procedure and .the content of the home interview the reader is referred to 
SZS Report 2. 

. / 

The Determination of Educational Disadvantace-ent 



As a part of the Longitudinal Study, math and reading subtests of the Com 
hensive Tests 



of 3asic Skills were given to every child in the s'araple. Since 



the sample for the Participation Study was a suhsample of the sample fo 
Longitudinal' Study, 'the achievement test scores were available for each _ 
student. Congress had defined- educational disadvantagement in terms of grade 
equivalents, a measure that has several psychometrically undesirable charac- 
teristics. As a result the grade equivalent score for each student was 
'determined, but we also ascertained the percentile score and vertical-scale 
score for each student. Mope details regarding the determination of educa- 
tional status can be found in SES Report 2. 

ECONOMIC STATUS AND SELECTION FOR COMPENSATORY EDUCATION 

Congress wanted to know several things. It wanted to know, from the popula- 
tion of poor children, how many were receiving CE services and how many were 
not. It also wanted to know how many students were receiving CE services 
who were not poof. Whether or not a student came frcm a family that was 
poor was determined by applying the Orshansky index" to information collected 
durinq the home interview.* Table IV- 1 shows both the percentages of student 



*rVFDC was also included. 



receiving CE 


when classified as poor or non-poor and also the 


estimated tot 


ai 


numbers of such students. Note that students ar^ classified 


as receiving 




Title I or Ti 


.tie I and/or Other CE , Other CE only, no CE a: a 


school .having 


■ 


CE , or no C5 


at a school which does not offer CE. 








Table IV- 1 








Percentage and Number of Students Receiving Var 


ious 






CE Services by Family Econrmlc Status 








CE Status 








Title I or Title ' I Other CE No CE at 


No CE at 




Economic Status 


and other CE only CE School 


Non-CE School Total 


Poor 


29% .1% 53% 


7% 


100% 


Non-Poor 


11 10 64 


" 16 


101 




Number of Students 






Poor 


1, 230,000 443,000 2,199,000 


309,000- 


4,181,000 


Non-Poor 


1,693,000 1,551,000 10,065,000 


2,516,000 


15,825,000' 


Total 


2,923,000 1, 994, 000 12,264,000 


2,825,000 


20,006,000 



Source: Report 2, Table ,11-1. 



What message can be drawn from this table? The interpretation of the numbers 
varies depending on one's expectation as to whether or not CE should go 
primarily to poverty-level students. Forty percent" of all poverty-level 
students receive some kind of CE, but 21 percent of the non-poverty-level 
students are also receiving CE- One can reflect that, percentage-wise, twice 
as many poverty-level students as non-poverty-level students receive CE* 3ut 
in terms of the total number of students, there are about 16 milj-ion non- 
poverty-level students and about 4 million poverty-level students; of these, 
there are about 1,690,000 non-poverty-level and 1,230,000 poverty-level 
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students receiving Title I. Thus, nore non-covarty-leval than poverty-level 
students receive Title I. Or to look at the other side of the coin, 50 percent 
of thepoor students and SO percent of the non-pcor do not receive Title I. In 
teras of the total number of students, about 2.5 million poor students do not 
receive CZ, while about 12.5 million non-poor students do not get CE. Roughtly 
speaking, there are about 1.7 million poor students receiving CE , and about 
2.5 million poor children not receiving it. In brief, in absolute numbers, 
there are somewhat more non-poor than poor students receiving CZ. (These 
figures are for Title I and Other CE combined. The picture is similar for 
Title I considered separately.) 

In this bad? It depends on what students one thinks should be targeted to 
receive Title I services. Remember that the funds go to poor districts and 
.schools, but the individual students "selected to receive Title I services are 
selected on the basis of educational need, not in terms of ecor.cmic status. 
Furthermore, the definition of poverty is such that only the lowest 21 percent 
of the students. are classified in the poverty group. One might speculate that 
the vast majority of those receiving CZ and classified as non-poor are just 
above t>.e poverty level. Table IV- 2 indicates that this is not the case. 

It will be seen that there is a progressive decrease in the percentage of 
students receiving Title I services as family income increases. A similar 
but less marked tendency is evidenced by the numbers for "Other CZ only." 
Since Title I is more of a poverty program than most other CE programs this 
is the relationship we would expect to see. However, the idea that non- 
poverty students selected for CZ are hovering just about the .poverty line is 
dispelled by the table. Clearly there are .significant percentages of CZ 
students who are not. in the two lowest fifths of family inccme. As will be 
seen in the next section, the correlation between student income status and 
educational achievement status is relatively low. Thus, to the extent that 
students are selected for CZ programs on the basis of their educational need, 



123 



Table IV-2 



Percentage and Number of Students Receiving Various CE 
Services by Family Income, 





Title I or 




■ No CE at 


No CZ at 




Title I and Other CE 


a CE 


a Non—Cr- 


Family Income 


Other CE 


Only 


School 


School 


T/M )Q cf ■? 
XAJWcbL r X Jm wii 


37% 


21% 


17% 


1 J % 




24 


27 


18 


lb 


Third Fifth 


17 


21 


20 


22 


Fourth Fifth 


13 


16 


22 


22 


Highest Fifth 


8 


14 


23 


25 






Number of Students 




Lowest Fifth 


1,090,000 


428,000 


2,070,000 


360,000 


Second Fifth 


702,000 


534,000 


2,226,000 


514,000 


Third Fifth 


507,000 


427,000 


2,460,000 


616,000 


Fourth Fifth 


390,000 


320,000 


2,695,000 


616,000 


Highest Fifth 


234,000 


285,000 


2,813,000 


719,000 


Totals 


- 2,923,000 


1,994,000 


12,264,000 


2,825,000 


Source : Special 


tabulation for the final report. 




we would expect 


many of those 


selected to come 


from non-poor 


families, even 



J though they, are enrolled in schools with relatively high percentages of poor 

; students. 

1 POVERTY AND THE CHARACTERISTICS OF STUDENTS SELECTED FOR CE 

We have already seen that proportionately more poor than non-poor children 
s * , 

j are selected for CE. What about some of the other student characteristics, 

i such as race, urbanism and region of the country? Sometimes it is thought 

•? 
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that CE programs are primarily for black children in the ghettos of large 
cities, "as can be seen from Table IV-3, that is not the case. If we combine 
the number of students receiving CE under Title I and from other CE funds' we 
see that, among poor whites, 37 percent receive CE ; among poor blacks, 40 
oercent receive CE; and among poor Hispanics, 47 percent have CE services . 
At the same time we find for the non-poor that 19 percent of the whites, 27 
certent of the blacks, and 44 percent of the Hispanics receive CE . Looking 
"at the poor and the non-poor together, we see that proportionately somewhat ^ 
fewer whites than blacks, and somewhat fewer blacks than Hispanics receive CE. 
There are, however, classification problems in eraser." r.g the results in this 
fashion. Although we instructed the teachers not to count those participating > 
in bilingual programs as CE students, we suspect that some teachers did so, 
and this accounts for the relatively high percentage of Hispanic students 
listed in the "Other CE only" category. Likewise, among the non-poor, it is 
orobable that the blacks and Hispanics ■ are lower in the economic status scale 
than are the whites, and thus more near-poor blacks and Hispanics receive CE . 
Thus, it seems probable that about the same proportion of blacks and Hispanics 
receive CE and that relatively more of them receive CE than whites. 

As al~eadv noted, it is frequently thought that CE is a program for students 
in large city ghettos. Table IV-4 shows that this is not the case, although 
there are. many CE students in large cities. The percentage of .those receiving 
Title I and "Other C2 only" combined, among the poor, is 46 percent for rural 
areas, 45 cercent for cities over 200,000, 35 percent for cities under 50,000, 
34 oercent for suburbs, and 28 percent for cities from. 50,000 to 200,000. 
The" order is the same for the non-poor, with 26 percent for -rural, 24 -percent 
for cities over 200,000, 19 percent for cities under 50,000, 17 percent for 
suburbs, and 15 percent for cities from 50,000 to 200,000. .The number of 



*From the point of view of equality of services, it is not quite appropriate 



Title I and those receiving CE service 



to add together those receiving, 
rinded from other sources.' The costs of service under "Ctner CE only is 
about a quarter less than under Title I. 
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Table IV- 3 



Percentage of Students Receiving Various CZ Services 
by Family Economic Status and Racial/Ethnic Group 





CE Status 


Economic 
and Racial/ 
Ethnic Status 


Tl tip T nr 

Title I and 
Other CE 


Other CE 
Onlv 


No CE 
a t CE 
School 


No CE at . 

Non-CE 

School 


Numbers of 
Students 


Poor and: 












White 


27% 


10% 


55% 


8% 


2,011,000 


Black 


33 


9 


51 


7 


1,501 ,000 


Hispanic 


29 


18 


51 


2 


556,000 . 


Other 


38 


6 


35 


20 


113,000 


Non-Poor and : 












-White 


9 


10 


65 


16 


13,546,000 


Black 


19 


8 


55 


18 


1,266,000 


Hispanic 


24 


18 


54 


5 


696,000 


Other 


5 


5 


43 


47 


317,000 


Total 


2,941,000 


2,000,000 


12,264,000 


2, 801,000 


20,006,000 



Source: Report 2, Table II-3 * 
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Table IV— 1 



.Pe-centage of Students Receiving Various 

by Family Economic Status and Urbamsa 



CZ Services 



Economic and 
Urbanism Status 



Title I or 
Title I and 
Other CZ 



Poor and 

City over 200 ,000 
Suburbs 

City from 50,000 
to 200,000 

- City under 50,000 

. Rural 

Non-Poor and 

City over 200,000 " 
■Suburbs 

City from 50,000 
to 200,000 

City under 50,000 

Rural .' 



Total 



33% 

IB 

15 

27 
36 



16 
5 

5 
12 
13 



Other CZ 
Only 



12* 

16 
13 

a 

10 



8 
12 

10 
7 
13 



No CZ 
at CZ 
School 



50* 

61 

52 

57 
49 



65 
68 

50 
66 
64 



No CZ 
at Non- 
CS School 



5* 
5 

20 

8 
5 



11 ' 
15 

35 
15 
10 



Number 

of 
Students 



1,334,000 
233,000 
443 ,0CC 

l,133,OOC 
1, 033,0 0C 



1,757,00? 
2,421,001 

2,10S,00i 
4, 969, 00 
4, 573,00 



2,941,000 2,000,000 12,264,000 2,801,000 20,006,00 



Source:- Report 2, Table 11-8. 
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students from rural areas receiving CE outnumbers that for any other category. 
The percentages for the suburbs tend to be lower than far large ci-ies and 
rural areas, but there is still a sizable number of students receiving CE in 
the suburbs- While there is a trend for CE to be most prevalent in the large 
cities and rural areas, it is significant that there are sizable numbers of 
CE students throughout the country, irrespective of the population density of 
the area in which they live. 

While some say that CE is for the ghetto, others think of it in terms of a 
program for "the poor rural south." Again this is not in accord with the 
facts- Table IV-5 shows the percentage of students receiving services by 
region of the country. If Title I services and "Other CE only" are combined, 
among the poor,. 51 percent of the students in the West, 42 percent in the 
Mid-Atlantic, 41 percent in the South/ 38 percent in the Northeast, and 30 
percent in the Midwest receive CE. The picture among the non-poor is differ- 
ent than it is for the poor- For the non-poor, the Northeast with 31 percent 
and the West: with 26 percent are considerably higher than the other areas, 
which are quite close together, with the Mid-Atlantic and the Midwest both 
having 17 percent, and the 'South having 15 percent. To understand this, it 
is worthwhile to look at the Title I and the "Other CE only" figures separ- 
ately. Among the poor, is is noticeable that the percentage for Title "I in 
the South is much higher than elsewhere in the nation. Associated with this 
is the fact that the South is lowest in "Other CE only," reflecting the fact 
that there are few local or state CE programs in the South. In fact the 
percentage of students receiving Title I services, both for the poor and the 
non-poor is fairly similar thoughout the country, except for the South- The 
big differences are in. the "Other CE only" category where the South and Mid- 
west have few programs, in contrast to the West and Northeast, which have the 
most. The relatively larger number of students receiving Title I services in 
the South is probably a reflection cf the relatively lower economic status of 
the South and the influences of the Title I allocation formula that allocates 
larger sums to "states having more poor families. 
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Table IV- 5 



Percentage of Student: 


s Receiving 


Various CZ 


Services 




by Family Economic 


S.tacus and 


Geographic 


Region 








C 


E Status 








Title I or 




No CZ 


- No CZ at 




Economic and 


Title I and 


Other CZ 


at CZ 


Non-CZ 


Number of 


Regional Status 


Other CZ 


Only 


School 


School 


Students 


Poor and 












Northeast 


24% 


14* 


59% 


3% 


853 ,000 


Mid-Atlantic 


24 


18 


49 


10 


330,000 


South 


38 


3 


50 


9 


1,443,000 


Midwest 


24 


6 


63 


6 


832 ,000 


West 


27 


24 


39 


10 


723,000 


Non-Poor and 








- 




Northeast 


10 


21 


56 - 


13 


2^,994,000 


Mid-Atlantic 


9 


Q 
o 


75 


8 


2,057,000 


South ' 


11 


4 


65 


20 


3/988,000 


Midwest 


11 


6 


72 


11 


4,473,000 


West 


•11 


15 


46 


28 


2,358,000 


Total 


2,941,000 


2,000,000 


12,264,000 


2,301,000 


20,006,000 


Source: Report 2, 


§ Table 11-9. 










Report 2 examines 


other student 


characteris 


tics relati 1 , 


re to select 


ion for CZ 


services/ but there are fewer in 


teresting t 


rends- There are sligh 


*«i y rno r e 


male than female CZ students; ah 


out a 4-per 


centage-poi: 


it differer.c 


e . Also, 


there tends to be 


slightly more 


CZ offered 


to students 


in the second, .third 


and fourth grades 


than to those 


in the firs 


t grade or 


' n the fifth 


and 


especially the sixth grade. 
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In summary, poor students arc more frequently sol-acted" to receive C2 servicer, 
than non-poor students, but because there are more non-poor than poor students, 
there are larger numbers of non-poor . students rnceiving CE , Relatively, there 
are more Hispanic than black students, and more black students than white 
students receiving CE $ but in terms of absolute numbers, there are rr.ore whi 
students- than black students receiving CE, and more black students than 
Hispanic students receiving CE . Again, in terms of percentages, there are 
more CE students ia rural areas and large cities than there are in medium- and 
small-sized cities. The percentage of students receiving Title I services is 
quite uniform over :.he rerr.ons of the country, except for the South, where 
there is a much higher percentage receiving Title I. But when "Other CE only" 
is included a different pic-cure emerges. The South has a very low percentage 
of students in these other programs while the West and the Northeast have 
high percentages. It appears that other federal agencies, and the state and 
local governments, are funding sizable programs in the West and the Northeast, 
and to a lesser extent in the Mid-Atlantic area, while there are few such 
programs in the Midwest and even fewer in the South. 

EDUCATIONAL ACHIEVEMENT M'D SELECTION FOR CE "\ 

Schools are selected for receipt of Title I resources based on the economic 
status of the p anul* tions- they serve. But once a school receives Title I 
resources the students are selected to receive Title I services on the basis 
of educational need. Title I regulations give guidelines as to which students 
should be selected. Generally, it is expected that the most- educationally 
needy students will Ije selected first and that the students selected will be 
in the bottom. half of the achievement distribution. But within these broad 
guidelines the actual selection of students is left up to the local district 
and school authorities. Thus, from locale to locale, one finds considerable 
variation in the achievement level of students selected. 
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In the Participation Study all the students tool-; tho Comproho.n;;,ive 7 oat a or 
Basic Skills in reading and math in the fall and again in the spring. Based 
on the scores obtained from the several administrations, scales were developed 
which allowed us to convert raw scores into percentiles and into vertical- 
scale scores, and to determine the score corresponding to the median for each 
grade. This median score was necessary because, for the purpose of this 
study, educationally disadvantaged children were defined by Congress as 
"children who are achieving one or more years behind the achievement expected 
at the appropriate grade level for such children." Table IV-S shows the 
percentages and numbers of students in various CE categories in terns of 
grade equivalents as measured by the CT3S . 

Table IV- 6 

Percentage and Number of Students Receiving Various 
CE Services by Educational Achievement Status 







CE 


status 








Title .1 or 




No CE- 


No CE at 




Educational 


Title I and 


Other CE 


" at CE 


Non-CE 




Achievement 


Other CE 


Only 


School 


School 


Total 


Low Achievers* 


31% 


15% 


42% 


12% 


100% 


Regular Achievers 


10 


9 


66 


15 


100% 






Number of Student 


s 




Low Achievers 


■1,188,000 


577,000 


1,576,000 


456,000 


3 ,797, 0C 


Regular Achievers 


1,307,000 


' 1,068,000 


8,245,000 


1,943 ,000 


12,568 ,'0C 




2,495',000 


1,645,000 


9,821,000 


2 ,404 ,000 


16,265,0C 


*Cmittlng the first gr 


ade, since it 


does net fit 


into the de 


f initio n o 


f having 



students "one grade level .below." 
Source: Report 2, Table 3-1' 
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If. will bo soon that; in tr.i3rm:s on p-jjrauutagaa fchcsre .\ro many taoro i-*, tUi.lontu 
selected cor CE services who are par conning at least one graJo Laval bo low 
their assigned grade levol than thure are among higher-achieving students. 

Forty-six percent of the low-achieving students* are selected for some CE 
while only 19 percent of the regular students are selected. At the same time, 
54 percent of the low-achieving students are not receiving CE services. In 
terms of absolute numbers, about 2 million low-achieving students are not 
receiving extra services, in contrast to about 1.75 million who are receiving 
CS services. It should also be noted that about 2.4 million high-achieving, 
students' are ' receiving CE services. It is clear that many students are 
receiving CE who are less educationally needy than the many needy students 
who are not receiving CE. We will see some of the reasons for this later 
when we consider the joint relations between economic status, which determine 
which schools receive CE funds (such as Title I) and educational status, which 
determines those students within a school who are selected. 

There are a number of psychometric problems in defining achievement in terms 
of grade equivalents. For one thing, the first-grade students cannot' be 
defined in terms of being one year below grade level. . Also, the amount of 
variance or spread in student scores changes from grade to grade. For 
example, in the sixth grade there may be students three or more years below 
grade level, but in the second grade they can only be one year below. The 
result is that different percentages of students"* are included in one year 
below grade level as grade level changes. There are also other statistical 
problems. The interested reader is referred to Tallmadge, G::<.,'and Wood, 
C.T. (23) , for a detailed discussion of the problems with using the grade 



S * 11 Low" and "Regular Achievers' 1 are defined as achieving below or above one 

* year .below grade level. This definition was contained in the law authorizing 

! the Participation Study. Selection, of students for Title I is based on 

\ several criteria. The Title I regulations suggest that all children below 

• ! the median be considered. 

: . * " ■ . • ■ • ^ 
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equivalent mrttr.1.:. Booau:.iu on thir.iM lu-obUiiun , wo convortod ^oh :V: 
raw acaca to a purjonttla and divided t!\o di:i tr i.bution J into qvuu'ti 
IV ~ 7 shows the results. 



TablQ IV-7 

Percentage and Number of Students Receiving Various 
CE Services by Achievement Quartiles* 









CE 


Selection S tatus 






Title I or 






No CE 


No CE at 




Achievement 


Title I and 




Other CE 


at CE 


Non-CE 




Status 


Other CE 




Only 


School 


School 


Total 


Bottom Quartile 


32% ' 




14% 


42* 


11% 


99* 


2nd Quartile 


19 




11 


58 


12 


100% 


3rd Quartile 


7 




,8 


70 


15 


100% 


Top Quartile . 


2 




6 


75 


17 


100% 








Number of Students 




Bottom Quartile 


1,579,000 




718,000 

j 


2,110,000 


560,000 


4 ,967,000 


2nd Quartile 


910,000 




543,000 . 


2,809,000 


605,000 


4,367,000. 


3rd Quartile 


368,000 




411,000 


3,600 ,000 


762,000 . 


5,141,000 


Top Quartile 


* 89,000 




301,000 


3,772,000 


869,000 


5,031,000 




. 2,946,000 


1,973,000' 


'12,291,000 


2,796,000 


20,006,000 


♦Derived. from Table 


V-5 , Report 


»2. 










There is a clear t 


endency for 


ther 


a to be proportionately 


-ore CE students as 


. achievement scores 


decrease . 


This 


i s tru e o 


f both Title I 


and "Other 


CE only." 


It should be noted 


1 that w he pe 


r c en 


tace of st 


vide n to in the 


bottom quar 


rile is 


very similar to zr 


.e number in, 


the 


previous t 


able who are one year bel 


cw grade 


level. (The absolute numbers 


b e twee n the two tab I e s c anno 


z be ccmpar 


ed 


because Table IV- c 


) does not incluc 


e first gr 


acers.) It ap 


pears that 


the 
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aiUucuion or atudont^ aarrovipoivrUi r;oa:Kmabl.y wo .11 with tho odiu'Mt L >na I nuud of 
tho utudonta, Uifc a fairly latrrjo numbor; oil atui.Umw who da not: tinom to noorl CM 
are roc.-3ivi.iv7 it. About .150,000 Tit. I a I studunta, and 700,000 "Ouhor C2 only" 
stiUtmts, ara above tho median in achievement and arc rocoiving CE tiorvlcon • 
Somo of those students may bo misclansitf led duo to tho unro.liabi.lity of thu 
CTBS, but a similar number below the median should bo classified abovo it, so 
the figures average out. Also, some on tho CE selections are in schools which 
arc 100 percent CE , which is allowed by Title I under curtain conditions* 

While significant numbers of educationally non-needy students receive CE, the 
more significant problem is the 2,700,000 students who are in the lowest 
quartile academically and who do not receive special services; or, if one 
believes that all students below the average should receive CE, one would be 
concerned with the 6,100,000 students who are in .the bottom half in terms of 
achievement and do not receive CE . Clearly, if all students who are above the 
median and receive CE'were to be replaced by students below the median there 
would still be sizable numbers of students below the median who would not 
receive CE services. The only way to assure that all students below the 
median receive CE is to dilute the services being given so more students could 
receive a little, or to increase the funds so that more students could be 
given services at the same intensity level as 'is currently practiced. 

EDUCATIONAL ACHIEVEMENT STATUS AND THE CHARACTERISTICS OF STUDENTS SELECTED ■ 
FOR CE ' 

We have already examined the relationship betwe en po verty status arid' the char- 
acteristics of students selected for CE. While at the student level the cor- 
relation between poverty and educational achievement is not high, it is con- 
siderably higher for school averages. 3ecause of the higher correlation at 
the group level, we 'would expect the relationship between educational achieve- 
ment status and the characteristics of students selected for CE to be fairly 
similar to that: found when these same student characteristics are related to 
poverty. The achievement levels of students by race/ethnicity who are selected 



for CSi WJt'O ojcaralnorl, Tlu» ennuis ahow r;f;u.i.U:: r« Ut L:^hU- ^' 

for poverty, although tho trun«:l« do not s^ui t,, V,i qui to i^n-un-M wh^n 

atuclrmt::! clarified by educational Aoh-I moment . 

Again there are same intaraattng troiulu in the relationship between achievement 
status and urbaniam with roapact to ^election for CS, Aa with poverty, students 
from large cities and from rural areas are moat frequently elected for CS 
services, Thia is true cor atudontn who are either law or hi -jh achievers. 

On examining the relationships between geographic regions of the country and 
selection for CS, we again find, that the Northeast and the West have the 
highest percentages of students selected for CE services, while the South has 
the lowest. Again, the South is low because it has so few students served by 
other federal, state or local programs. Almost all of the students served 
in the South are served by Title I. 

THE JOINT EFFECT OF ECONOMIC STATUS AND EDUCATIONAL ACHIEVEMENT 

It seems probable that the supporters of the Title I program' assumed an almost 
one-to-one relationship between poverty status and educational achievement. 
It is- widely believed that schools in poor areas have students who score poorly 
on achievement tests. But what is the actual relationship?' In the Participa- 
tion Study we were able to relate family income with achievement'' test scores. 
The overall correlation between economic level and achievement scores at the 
student level 'was .29, and varied, grade by grade, from .20 in the first grade 
to .32 in the third and fourth grades. Relationships of this magnitude are 
ceneraliy considered small-to-moderate and impZ y that if one knows a student's 
economic status one can predict the student's achievement level with only 
modest success. It is this low relationship that partially accounts for the 
finding, reported earlier, -hat many non-cccr students perform poorly and are 
receiving CS. Cn the other hand, when groups of students are combined,- say by 
taking the average achievement level for a school, then the combined average 
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:i.vn:<*:i i:uL-ii:ti more highly. I'M M.:M:, WiHMi t ' 1 1 * i ^v»u:..h|«j r nil i. 1. y :. jh« -.m i ■ : Invul 
t:or 4 :3(Jhr.)0.l Ui qatwu l,t f.m I wi.'li 1 u:i av^raiju student". .t'-:lv L « M\ t; luvol 
dl:udont;:.i In a aahooi, the Lit I •: a Ui ,n7, ThUi nuvuvi t:|ut: in nnu kiv»w.i 

t;ho Avei,vujn puvrM'Uy .U»vol on a n^liool on«a can p^ui-IUm; iilte average | ; un; rViraianeu 
ot!' aUiuUmtia in tins tichool much mom .nccuiM^ly than onn produu. the 
achievement Level oi? any given sjtudisnt; on the basis at: the ^tudant' family 
economic level. , 

Whan achoola are al.Locat.ed CE fund si ba^ed on nqvet/r.y l.svel, the :if.udeut:i will 
tend to be low achievers if the school i: ; J within a poverty area, but there 
may also bo many individual students who are regular achievers; and converse! 
if schools are not given CE funds because of their Relatively high economic 
levels, these schools will still probably contain many students who need CE 
services as indicated by their low achievements . Table. IV-8 shows the mean 
achievement -percentiles for students with various family incomes. This table 
illustrates the marked relationship between family income and achievement 
when data are grouped, but such grouped data mask the wide variation within 
any group. The large standard deviations emphasize this fact. 

Economic status and achievement level are related to a number of' other vari- 
ables. As in the previous sections, we will examine the joint relationships 
among poverty, achievement: level, and race, urbanism, and geographic region, 
and we will also consider the relationship of CE selection to the child's sex 
and mother 1 s education. Table IV-9 shows the relationships between poverty, 
'achievement and race.* The average achievement -percentile for whites is 56, 
while that for bracks is 32 and for Hispanics 31- "Others," who are largely 
Orientals, have an average percentile .of 51. When examined in terms of 
poverty, the poor whites' have an average score of 41, while that for -non-poor 
whices is 57. In comparison the score for both the poor blacks and poor 
Hispanics is 27, while that for -the non-poor blacks is 3 6 and for the non-poo 
Hispanics it is^ 34. It "Should be noted that the score for the non-poor black 
and Hispanics is below that of the poor .whites. No doubt the economic level 
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Table IV- 8 

Students' Family Income and Achievement Level 





Mean Achievement 
Percentiles* 


S tand-ard 
Deviation 


N 


3elow $5000 


34 


25 


1524 


5,000 to 7,0.00 


37 


25 


1005 


7,001 to 9,000 


41 


27 


1109 


9,001 to. 11, 000 


45 


28 . 


1183 


11,001 to 13,000 


43 


28 


1234 


13,001 to 15,000 


. 52 


28 


1259 


15 ,001 to 17,000 " 


53 


29 


1243 


17,001 to 19,000 


57 


28 


1146 


19,001 to 21,000 


58 


23 


997 


21,001 and above 


62 


27 


3087 



♦There are technical statistical reasons why it is usually inappropriate to 
average percentiles; however, when used to show a trend, as is done here, 
the practice is less objectionable. 

Source: Report 2, Table IV-6. 



Table IV- 9 

Students 1 Family Income , Race, and Achievement Level 



Race/Ethnic 
Group 


Mean 
Poor 


Achievement 
Non-Poor 


Percentile 
Total 


Poor 


Non-Poor 


Total 


White 


41 


57 


56 


1,192,000 


10,598,000 


11,173, 


Black 


27 


36 


32 


949,000 


1,100,000 


2,049, 


Hispanic 


27 


34 


31 


343,000 


590,000 


933 


Other 


33 


56 


51 


70,000 


260,000 


330- 



Source: Report 2, Table IV- 7 • 
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of the non-poor blacks and Hispanics .is lower than that of the non-poor whites, 
but it is above the economic level of the poor whites. Children from black 
and Hispanic non-poor families need CE considerably more than children from 
the non-poor white families, but also more than those from many poor white 
families. The "Other" minorities are more similar to the whites than they 
are to the blacks and Hispanics. 

Poverty level and the parents' formal education are linked, and children's 
achievement levels are also related to both economic status and the parents' 
education. Table IV-10 shows tnis relationship. It is seen that the percen- 
tile achievement level of children whose mothers had eighth grade educations 
or less is 32 and that the level of achievement progresses regularly to 70 
for students whose mothers are college graduates. 

Table IV-10' 

Students' Family Income, Mothers 1 Education, and Achievement Level 



Mean Achievement Percentile N 

Mother's 



Education 


Poor 


Non-Poor 


Total 


Poor 


Non-Poor 


Total 


Grade 3 or Less 


28 


35 


32 


793,000 


917,000 


1,710,000 


Grade 9-11 


31 


44 


40 


*892,000 


2,269,000 


3,161,000 . 


Grade 12 


38 


55 


53 


635,000 


5,518,000' 


6,153,000 


Some College 


48 


62 


61 


185,000 


2,382,000 


2,567,000 


College Graduate 


60 


70 


70 


50,000 


1,409,000 


1,459,000 


Source : Report 2 , 


Table 


rv-ii. . 
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The achievement: of children from poor homes is considerably below chat of 
thei>: peers who are from non-poor* homes but whose mothers had the same amount 
of formal education. The jump in scores between the children of mothers with 
am eighth grade education or less and those with a high school education is 
21 percentile points, and that between high-school-educated mothers and 
college graduates is 17. The jump between children whose mothers had similar 
educations, but whose family income places them in the poor or non-poor cate- 
gory, is about 12. Thus, a mother's education seems to have a larger effect 
on her child's achievement than does her' economic status. 

Table IV- 11 shows the relationship between economic status, academic achieve- 
ment, and urbanicity. The table shows that, in general, the achievement level 
is near the 50th percentile except for the suburbs, where it is 59, and for 
the. large cities, where it is 38. This very low score for the large cities 
means that they should have many students enrolled in CE programs, and indeed 
this is the case. But we have previously seen that rural areas also have 
many students in CE programs, and yet they have achievement levels slightly 
above the national mean. This probably reflects the relative poverty of rural 
areas, whereby they get relatively more Title I funds than would be indicated 
by the achievement levels of rural students. Within urban areas of the same 
size, there is a marked difference in the achievement levels of students from 
poor and non-poor families, with the children from poor .families scoring about 
17 percentile points below those from non-poor families. 

The analyses done over regions of the country are shewn in Table 177-12 and 
show both expected and unexpected results. As reflected by the overall 
figures, the rank order of the regions, in terms of achievement, is Midwest, 
Northeast, Mid- Atlantic , and South and West tied at the bottom. The rank 
orders, when examined separately for the poor and the ncn-pcor, are essen- 
tially the same. As expected, the Midwest and Northeast are at the top of 
the rankings, and the South is at the bottom. 3ut what is unexpected is that 
the West should, be at the bottom with the South. When the West is examined 
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Table IV-11 



Students 1 Family Income, Urbanise, and Achievement Level 





Mean 

Poo y 


Achievement 

nun * uu^ 


Percentile 
Total 


P oor 


N 

Non-Poor 


• Total 




City over 
200 ,000 


27 


44 


38 


802,000 


1,409,000 


2,211,000 


Suburbs 


35 


61 


59 


144,000 


1,379,000 


2,023,000 


City from 50 # 000 
to 200,000 


33 


55 


53 


254,000 


1,675,000 


1,929,000 


City Under 
50,000 


37 


55 


52 


675,000 


3,924,000 


4,599,000 


Rural 


37 


55 


52 


668,000 


3,577 ,000 


4, 245,000 


Source: Report 


2, Table 


IV-9 . 












Students 1 


Table IV-12 
Family Income, Geographic Region 


, and Achievement Lave! 




Geographic 
Region 


Mean Achievement Percentile 
Poor Non-Poor Total 


Poor 


Non-Poor 


Total 




Northeast 


36 


58 


54 


474,000 


2,414,000 


2,888,000 




Mid-Atlantic 


34 


55 


52 


195,000 


l,618 f 000 


1,813,000 




South 


31 


49 


45 1, 


013,000 


3,117,000 


4 f 130,000 




Midwest 


40 


60 , 


58 


497,000 


3,533,000 


4,030,000 




West 


30 


48 


45 


407,000 


1,939,000 


2,346,000 





Source: Report 2, Table IV-3 . 
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in -more detail it turns out that Pacific Northwest children have scores which 
are slightly higher than those for the Midwest, but the scores for. the Pacific 
Southwest are lower than for any other sub-region of the country. This is 
presumably due to the fact that there are many Hispanics in the Pacific South-- 
west and, as we have previously seen, their scores are among the lowest of 
any group. This finding should be interpreted cautiously because of possible 
sampling errors for sub-regions, and because of problems that many Hispanic 
children may have had with an achievement test . where the test items were in 
English (but it should be noted that the instruction in the schools was also 
in English) - Nevertheless, there are large regional differences and the need 
for CE is reflected in these regional differences in achievement. 

Finally, it should be noted that there are sex differences associated with 
CE selection. It has long been known that at the t elementary level girls, 
score higher on achievement tests than boys. Table IV-13 demonstrates this 
fact. It will be seen that for both poor and non-poor children the mean test 
score for girls is somewhat higher than for boys. There are thus more boys 
receiving CE than there are girls. This should not be attributed to sex 
discrimination/ but rather to the fact that, in terms of a uniform standard 
of achievement, boys need CE more than girls do . 



Table IV-13 

Students 1 Family Income, Sex, and Achievement Level 





Mean 


Achievement 


Percentile 








Sex 


Poor 


Non-Poor 


.Total 


Peer 


Non-?oor 


Total 


3oys 


31 


52 


49 


1,263 ,000 


6,409 ,000 


7,672,000 


Girls 


36 


57 


54 


1,253,000 


6,098,000 


7,351,000 


Source : 


Report 2, Table 
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At the beginning of this chapter we mentioned Congress' requirement that a 
study be undertaken to determine the number of students receiving Title I 
services as a function of the poverty level of the families from which they 
came and also as a function of the levels of achievement. We will now examine 
the joint effect of poverty and achievement on selection for CE services. 
Table IV-14 shows the percentage of students selected for CE as a function of 
the definitions in the law, namely poverty, defined in terms of the Orshansky 
Index, and achievement defined in terms of low or regular achievement. One 
can determine from the table that 74 percent of the students go not receive 
any CZ , 15 percent receive Title I, and 10 percent receive Other CE . Of the 
students who are both poor and low achievers ,■ 47 percent do not receive any 
CE while 53 percent do. Of those who are non-poor but low achievers, 53 per- 
cent do not receive CE while 42 percent do. Similarly, among those who are 
poor but regular achievers, 70 percent do not receive CE, while among the non- 
poor and regular achievers, 83 percent donoc receive CE — although 17 percent 
do. Ideally there would be no students in the low-achieving group who were 
not receiving CE, and there would be few regular-achieving students who are 
receiving it. But when one' considers the difficulty of correctly- classifying 
children (often based on subjective judgments and less than perfectly reliable 
tests)' the numbers shown seem to represent a reasonable performance on the par 
of the schools in selecting CE students. Given an effective selection system, 
the easist way of supplying CE services to the large number of educationally 
needy students who do not receive CE is to increase the funds available. , 

We have previously noted that the Office of Education regulations for Title I 
indicate that students should be' selected from the bottom half of the achieve- 
ment distribution. Table IV-15 shows how CE selection is related to poverty, 
as defined by the Orshansky .index, and achievement, defined as falling above 
or below the midpoint of the achievement distribution. Cinder this relaxed 
definition many more students are eligible for selection because they fall in 
the bottom half of the. achievement distribution. This table shows that 53 . 
percent of the students who are poor and in the bottom half in achievement do 
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Table IV- 14 



Students' Family Income, Achievement and CK s^l^ct^ on 

(Grades 2-6) 



Poor - Low Achiever 
Non-Poor - Low Achiever 
Poor - Regular Achiever 
Non-Poor - Regular Achiever 



Poor - Low Achiever 

Non-Poor - Lew Achiever 

Poor - Regular Achiever 

Non-Poor - Regular Achiever 
Total 



Title I/Title I 
and Other CE 



40% 
26 
22 
8 



573,000 

606 ,000 

442,000 

851,000 
2,472,000 



Other CE 
Only 

Percent Selected 



14% 
16 

8 

9 

Number Selected 



196,000 

376,000 

164,000 

900,000 
1,636,000 



No 



47% 
53 
70 
83 



671,000 

1,353 ,000 

1,391,000 

8,821,000 
12,241,000 



Source: Derived from Report 2, Figure VI-1, 
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Table IV- 15 



Students 1 Family Income, Achievement -an d CE 
with Different Selection Criteria* 





Title I/Title I 
and Other CE 


Other CE 
Only 


No CE 






Percent Selected 




Poor and bottom half in 

a/^h i ouonont" 


37% 




10% 


53% 


Non-Poor and bottom half 

-Lll dCillc v CUieuL 


20 




13 


a / 


Poor and top half in 
acuie venienL 


9 




7 




Non-Poor and top half in 

-a i q Tfo tn a n ^ 
aCiilc V cutcu u 


4 




7 




Poor and bottom half in 
achievement 






Number Selected 




916,000 




244,000 ' 


1,292,000 


Non-Poor and bo t tan half 
in achievement 


1,111,000 




736,000 


3,679,000 


Poor and top half in " 
achievement 


82,000 




65,000 


752,000 


Non-Poor and top half . 
in achievement 


278,000 




540,000 


6,605,000 


Total** 


2,387,000 




1,585,000 


12,328,000 



*Table IV-14 shows the percent , selected for CE in terms of the criteria 
selected by Congress for the Participation Study. This table retains the 
same, definition of poverty but divides the students in half on the achieve- 
ment criterion. 



**These totals differ from those in Table IV-14 because of rounding errors. 
Source: Derived from Report 2 r Figure VI-4." 
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not receive CE, while 57 percent of the r.on-pcor and low -achievers do not: 
receive CE. On- the other hand 15 percent of the poor and in' the upper half 
in achievement do receive CE and 11 percent of the non-poor and high-achieving 
students receive CE. In Report 2, other definitions of eligibility are con- 
sidered. The number of students who do or do not receive CE services varies 
considerably as various definitions are adopted. Thus, a judgment about how 
well students are selected and how many are served by CE programs depends 
largely on how poverty and achievement are defined. 

THE EFFECT OF DIFFERENT MEASURES CF ACHIEVEMENT 

The analysis of the number of children receiving CE as a function of achieve- 
ment level has been based on combined reading and math measures. That is to H 
say that a student's CE status was defined in terms of whether or not the 
student was receiving reading and/or math CE services, with achievement level 
being determined by the score on a combined reading and math achievement ■ 
scale. While the law requiring the Participation Study spoke of Title I as 
an overall program rather than in terms of reading services or "math services 
separately, it seemed desirable to see if the classification of students 
would be changed if the classification were based on a reading test, a math 
test, or the two combined. It has also been argued that the results might 
have been different if the analysis had been done_.sepaj:a tely , if the students 
receiving reading CE had been classified on a reading test and the students 
receiving math CE had been classified on the math test.' results , rather than 
on results from combining the reading and math tests. 

The reason the original analyses were done on the basis of the combined scores 
was the belief that the separate analyses would give essentially the same 
results as those based on combined test scores and that the law did not make 
any distinction. This belief was based on the fact that there was a high 
correlation between the combined score and either the math cr the rea di ng 
test: separately. Table 1-16 of Report 9 shows that these correlations 



range from a low of .32 to a high of .96. However, interest continued as to 
the nature of the results if the analyses had been done usin^ separate test 
scores. We therefore made a special analysis for this report. Table IV-1S 
shows the percentage of students receiving various CE services when classifie 
in terms of a reading test, a math test/ and both tests combined. Here the 
students are classified as CE students if they are receiving reading CS only, 
math CE only, or both. ...Table IV-17 shows similar results except: that the 
students are classified in terms of achievement test quartiles rather than in 
terms of grade equivalents. It will be seen that the results are very simila 
irrespective of how the classification is done. Thus, we conclude that the 
results reported in Reports 2 and 3 are invariant to the particular achieve- 
ment classification scheme used. 

As indicated above, it was also suggested that the classification of students 
should have been done separately for .reading or math CE services and the 
appropriate reading or math tests should have been used to make the classifi- 
cations. Again special analyses were done for this report and the results 
are shown in Tables IV-18 and IV-19. The tables show that the percentage of 
students classified in the various achievement levels by type of CE service 
are almost identical whether classified in terms of the reading test for 
reading CE or the math test for math CE or in terms of both tests combined. 
Of course the -tables also show that there are only about one half as many 
students classified as receiving - math CE as there are receiving reading CE. 
The results reported here are almost identical to those previously reported 
in Table 2-2 of Report 3. 

Our overall conclusion is that it makes little difference whether the achieve 
ment scores used to classify students on achievement are reading scores alone 
math scores alone, or both combined. The proportion of students designated 
as receiving various CE services in terms of levels of achievement is essen- 
tially the same irrespective of the particular achievement measure used. 
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fable IV-16 

» 

Percentage of Students Receiving Reading and/or Hath CE Services by Achievement 
Level tiased on Reading, Math, or Combined Achievement Tests 



Achievement 
level 


CE Selection Status 


Total 


Title I or • 
Title I and 
Other CE 


Other CE Only 


No CE at 
a CE School 


No CE at 
Non-CE School 


Reading Hath Doth 
\ \ \ 


Reading .Math Both 
\ \ I 


Reading , Hath Roth 
\ l \ 


Reading Hath Both ■ 
\ \ \ 


I.ow Achievers 

t 

Regular Achievers 


31 

20 

31 

9 

12 

10 


16 

17 

15 

9 

10 

9 


42 

45 

42 

69 

67 

66 


10 

11 

■ 12 

.11 

12 

15 


991 

ion 

1001 
981 

ion 

100* 



Source; Special tabulation for— this report. 
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Table IV-17 

Percentage of Students Receiving Reading and/or Hath CE Services by 
Quartiles on Reading, Hath, or tabbed Achievement Tests 

i 





CE Selection Status 


• 


1 


Title I or 
























Achievement 
Level • 


Title I and 
Other CE 




Other CE Only 


No CE at 
a CE School 




No CE at 
Non-CE School 


Total 




Reading Hath 


Both 


Reading 


Math 


Both 


Reading 


Hath 


Both 


Reading 


Hath' 


Both 








% 


% 


% 


% 


% 


\ 


% 


% 


\ 


\ 




Bottom Quartile 


31 

28 


32 


17 


16 


14 


A") 

HI 


46 


42 


^f\ 
IU 


10 


11 


1001 

loot 

991 


2nd Quartile 


1 ft 

20 


19 


13 


13 


11 


57 


57 


58 


10 


U 


•12 


99-j 
iOl'i 
100'j 


3rd Quartile 


7 


7 


9 


9 


8 


73 


70 


70 


11 


12 . 


15 


100% 
101% 
'100% 


To£ Quartile 


3 

3 


2 


6 


8 


6 


79 


79 . 


75 


12 


11 


17 


100% 
101% 
100% 



Source; Special tabulation for this report. 
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Table IV-10 



Percentagas of Studenta Receiving Reading (or Hath) CE Services by Achievement 
on Heading (or Math) Achievement Tents or Doth Testa Combined 





Reading CE Selection Status 




Achievement 
Status 


Title I or 
Title I and 
, Other CE 


Other CE Only 


Ho CE at 
. a CE School 


Ho CE at 
Hon-CE School 


Total 


" — " " i — 


Reading Doth 


Reading 
\ 


Doth 
I 


Reading Doth 
\ \ 


Reading 
\ 


Doth 
I 




One Grade Level 
Delow 


27 20 


17 


10 


46 M 


11 


10 


100% 


Above One Grade 
Level Ilelow 


8 7 


0 


0 


72 73 


12 


12 


1 flfll 

lUUi 


Source: Special tabulation for this report. 






Hath CE Selection Status 


• 


Achievement 
Status 


Title I or 
Title I and 
Other CE 


Other CE Only 


No CE at 
a CE School 


No CE at a 
Hon-CE School 


Total 




Hath Doth 
\ \ 


Hath 
l 


Doth 


Hath Both 
\ \ 


Hath 
\ 


Both 
\ 




One Grade Level 
Delow 


15 10 


i 

13 


M 


61 51! 


11 


10 


1001 


Above One Grade 
.Level Ilelow 


5 4 


Q 


7 


75 77 


12 


12 


is; 

1001 



Source: Special tabulation for this report. 
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Percentage of Students Receiving Reading (or Hath) CE Services by Quartilea 
on Reading (or Hath) Achievement Touts or lioth Tests Combined 





• 


Reading CE Selection Statin 










Status 


Title I or 
Title I and 
Other CE 


Other CE Only 


No CE at 
a CE School 


Ho CE at a 
Non-CE School 


Total 






Reading 
l 


Doth 
t 


Roading 
t 


Doth 
I 


Reading 
I 


Doth' 
1 




Bottom Qiartile 


27 : 2B 


17 


17 


46 


45 


10 


10 


1004 


2nd Quartile 


17 16 


12 


13 


61 


60 


10 


11 


loot 


3rd Quartile 


.5 6 


0 


0 


75 


75 


11 


11 


100* 


Top Quartile 


2 2 


5 


5 


01 


01 


12 


12 


loot 





Hath CE Selection Status 




Achievement 
Status 


' Title I or 
Title I and 
Other CE 

1 


Other CE Only 


Ho CE at 
a CE School 


No CE at a 
Non-CE School 


Total 




Hath Doth 
\ t 


Hath 
I 


Doth 
\ 


Hath 
I 


Doth 
t 


Hath 
t 


Doth 
\ 




Bottom Quartile 


14 16 


13 


13 


62 


61 


10 


10 


loot 


2nd Quartile 


9 ,9 


10 


10 


69 


70 


11 


11 


loot 


3rd Quartile 


4 '• 4 


0 


0 


76 


77 


12 


11 


1001 


Top Quartile 


1 

2 1 


7 


6 


01 


01 


11 


12 


loot 

1 



Source: Special tabulation for this report. 
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HOW A?£ STUDENTS SELECTED FOR CE? 

The selection of schools to receive CE resources and the selection of 5r.uder.c5 
for CE services are complex processes and vary considerably from district to 
district and from school to school. 5E3 Report 5 explores this problem in 
some detail. It concludes that in selecting schools for CE resources, dis- 
tricts use a number of criteria and that "the most frequently used criteria, 
either alone or in combination are: free or reduced-price lunch counts alone 
(22 percent), PlFDC enrollment alone (15 percent) and free or reduced-price 
lunch counts combined with AEDC enrollment [11 percent). The remaining 49 
percent of the districts reported using other combinations of criteria with 
no single combination being used by more than- 5 percent of the districts." 
Once a school receives CE resources it has the problem of how to determine 
which students actually are selected to receive these resources. Again, we 
find a number of different methods being used. When school principals were 
asked to indicate how CE students were selected they indicated the methods 
shown in Table IV-20. 

Test results and teachers 1 recommendations are the twc tost frequently used 
methods. Membership in targeted groups or parent:' requests are used ie?n 
frequently. 

Earlier we saw the relationship between poverty ^nd achievement level and 
student selection for CE services. We concluded *:h*\t generally the -schools 
were doing a reasonable job in selecting the educationally needy 3tudents for • 
receipt of CE services. Note that we resort to statements such as "generally" 
to describe the success in selecting CE, students. It would "be ce:i. ah 1 e to 
have a numerical index to 'describe the relationship between need £r:d selection 
a Targeting Index. If there were such an index it would alicw comparisons of ■ 
actual performances against some numerical standard. It would make it pos- 
sible to compare the success of selection practice between schools , districts, 
or other categories of interest. In . f iES lie port 13 a study is reported that 
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Table IV- 20 

Criteria Used by Title I Schools for Selection of CE 
Participants, and Selection Rates for 'Needy' and 'Non-Needy' Students* 



School 
Selection 
Criteria 


Percentage 
of 'Needy 1 
Students 
Selected 


Percentage of 
'Non-Needy ' 
Students 
Selected 


Test results alone 


51 


7 


Test results and teacher recommendation 


49 


4 


Some combination of test results, teacher 
recommanda tion , volunteer, and/or 
parent request 


47 


3 


Teacher recommendation alone or combined 
with parent request and/or volunteer 


49 


5 


Membership in one. or more target ■ groups 
only, or in combination with test results 


59 


10 


Target groups, test results, and teacher 
recommendation 


- 43 


7 


Some combination of target groups, test 

results, teacher recommendation, volunteer, 
and parent request 


40 


3 


All students in the school participate** 


(29) 


(3) 



*' Needy 1 and •Non-Needy 1 students are defined in terms of teacher's judgment, 
of student's need for CS services. 



**Scme principals reported that all students in their school participate in 
CE programs. However, the records of the Compensatory Education Roster 
do not indicate that all. students in these schools' are; selected- for Title 
I services / - . ■ ■ 

Source: Report 5, Table 8-3. ' 



inves tigates the appropria teness of a number of proposed targeting indexes. 
Twenty-five different indexes wore examined based on different assumptions 
about what such an index should measure. Here we- will examine only two of 
the possible indexes. The interested reader will want to turn to the full 
report* 

All of the indexes are based on the idea that within a school, students 
should be selected for CE based on educational need. In exploring the indexes 
the levels of achievement on the CT3S are taken as indicators of educational 
need. The first index uses the simple idea that the index should be based on 
the proportion of students selected for CE who fall below seme" cut-off point 
in achievement level. Thus, a school with all of its CE students below, say, 

the 50th percentile, and none of them above it, is presumably doing a better 
job of selection than a school where only half of the CE students are belcw 
the 50th percentile and half of them ere above that level. Table IV-21 shews 
the actual distribution of schools in our sample when the cut-off point is in 
the 50th percentile. The 50th percentile is based on the idea that Title I 
regulations suggest that Title -I students should be selected from those in 
the lower half of the academic achievement distribution. The 35th percentile 
was chosen because when teachers are asked which students they think are in 
need of CE services they tend to select- students who fall below the 35th 
percentile. The table should be . read as follows: for the 50 percentile 
cut-off it shows that if a school had 100 students receiving CE reading 
services then there were 2 percent of the schools where 60 of the students " 
were below the 50th percentile and 40 students were above the 50th percentile. 
Similarly there were 11 percent of the schools where out of 100 students, 63 
were belcw the 50th percentile and 32 were above it. At the mid-point in the 
distribution of schools , the typical school selected reading students in such 
a manner that 33 percent of the students selected for CE ■ were in the bottom 
half on achievement, and 12 percent in the top half . For math the split is 
34 percent in the bottom half and 15 percent in the top half. If the cut-off 
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Table IV- 21 



Percentage of Schools Having CS Selectees Who Score 
Above -and Below the 50th and 35th Percentile 



Percentacre of Students Selected for CE : 


Reading 


Math 


Below 50tn 


Percentile 


Above 50th Percentile 


% of 206 Schools 


% of 161 Schools 


36 




64 


0 


2 


44 




56 


1 


3 


52 




A D 
4B 


2 


4 


60 




40 


2 


5 


68 




32 


11 


11 


76 




24 


12 


13 


84 




1 c 
lb 


24 


24 


32 




Q 

o 


33 


19 


100 




U 


15 


19 


rse low jDtn 


Percenti le 


adovc o j ufi rerceni.1 ie 






12 




88 


0 


1 


20 




80 


0 


4 


28 




72 






36 




64 


„ - 




44 




56 


6 


7 


52 




48 


12' 


8 


60 




40 


13 


16 


68 




32 


17 


18 


76 




24 


21 


15 


84 




16 


17 


10 


92 




8 


6 


6 


100 




0 


1 


9 


Source: 


Report 13, 


Table 7-1. 
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split i-i. 70 
id 30 po-vceat 
bolow the 



is changed to tho 35th percentile than car the median school 
percent of -ho students below tho 35ch percentile in readi;v; a 
above it. For math tho split for the median school is 62 pore-, 
35th percentile and 33 percent above it. It will be nqticed that schools do 
a better job of selecting educationally heady students for reading CZ than 
they do for math CS, It will also be seen that the apparent success of school 
in selecting students to receive CZ varies depending on the cut-off level used 
the schools give the appearance of doing a better job if the criterion is the 
50th percentile. This fluctuation in the implications of the index is proba- 
bly net serious if comparisons are made between schools or districts, but the 
fluctuation is not desirable if an absolute standard is needed. The most 
serious problem with this index is that it considers only the characteristics 
of the students who are selected for CS and does not consider the character- 
istics of students not selected. A schcol with almost all of its students 
needing CZ would look very good on the index irrespective of whom thev 
selected, since almost all of the students selected would be below the cut-off 
point and there would be few students mis-selected. On the other hand a 
school with a smaller proportion of needy students might try to- do a very 
careful Job of selection but would make some classification errors and would 
look relatively poor on the index. A good index should consider the charac- 
teristics of both students who are selected and those who are not selected. 

An index to address that problem can be based on the phi coefficient. A phi 
coefficient provides a measure of the degree of relationship in a four-celled ' 
table. One could make up a table showing the number selected for CZ , the 
nusber not selected, and whether or not each student scored above cr below ' 
some defined achievement score. Such a table would look like the one below. 
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Achievement Scarf..- a 



Above 35th Parcen tilii Bolow 35 th Purcon t.t It 



Selected 



Not Selected 



0 


35 


65 


0 



Adjusted phi * 1,0 



The closer the relationship between selection for CE and scoring below the 
achievement criterion, the higher the phi coefficient. Also, when the 
coefficient is corrected for the marginal splits, it will usually vary from 
-1,00 to +1.00, thus giving an absolute standard. Table IV-22 shows the 
adjusted phi coefficients for our schools for reading and math. It will be 
seen that "a few schools do worse than would be expected by random selection, 
but most of them do better. and a few are very good in the quality of their 
selection. The median coefficient for reading is .53 and for math it is .48. 
It seems that for most purposes this Targeting Index is preferable to that 
based only on the characteristics of the students selected, although it 
requires more complex calculations. 

Other indexes can be developed. For example, instead of dichotomizing the 
achievement scores as above or below a certain cut-off, one could use the 
achievement scores as percentiles or as percentile ranks and compute a.point- 
biserial correlation. This has the advantage of using more of the .achievement 
information than does the phi coefficient. In Report 13 still other methods 
are considered, each with its advantages and disadvantages. The index to be 
preferred depends on the use to be made of it and on the ability to do com- 
plex calculations , The discussion in Report 13 includes a table that answers 
a number of questions for each index. The questions considered are: 
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Tablo r/-22 

Percentage of Schools By Adjusted Phi Coef f icients , Showing Relationship 
Between CE Selection and Achievement Scorns Dichotomized at the 35th Porcan 



Adjusted Phi 
Coefficient 



Reading 
% of School: 



Math 
\ of Schools 



Less than -.22 

-.22 to -.13 

-.12 to -.03 

-.02 to .02 

.03 to .12 

.13 to .22 

.23 to .32 

.33 to .42 

.43 to .52 

.53 to '.62 

.63 to .72 

.73 to .82 

.83 to .92 

.92 and above 



0 
0 
1 
. 0 
0 
6 
8 
12 
22 
21 
12 
11 
6 
1 



1 
2 
1 
3 
3 
7 

15 
9 

17 

14 
6 
7 
4 

11 



Source: Report 13, Table 7-10. 
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I .=5 the index easy to calculate, 1 

Do oil the index conaid U" the actual receipt: or: :irirvtoeq? 
Does tha index consider only CK student.;!? 
Ia the index based on national or school 'norma 1 ? 
Does the index consider all the needy students? 

Are the schools penalised if they provide CE services to all students? 
Are the schools penalized in they target CS to selected grades only? 
Does the index have a known sampling distribution? 

Ac firsc blush the development of a targeting index would seem like a single 
task but; when seriously considered/ it is quite complex. The discussion in 
Report 13 should be helpful to anyone trying to develop a targeting index. 




chapter v. now iwvvxi'vv/r: ccmp*%msatory ^nr.r^wVL* r.o;r? 



•Z'/i-ij al\aptax % is aonaorruid with thn amount of a<vii^v^uint growth r^^ulzing 
from Tit Lo I jjr'y-uwn. Fijnj*., a hypothetical example is jivan to illiu- 
tyate th*i problems involved in fjrmi>ig proper acrnpaviwi j^uvj, ,v\d iIjo 
to show the way students change in. C£' ji-siua /ww so y:\ir, Th*J 

.example will aid in % .o'\dov a tending :>ui major roaulSi*. "'n. 1 rojwi*.? 
presented by comparing the rate ->/ grouzh 0/ ?ii:. t 2 I students with thd 
rate of growth of Regular Needy student and Regular students, 7he 
results from the first year of the study show; 

0 In reading, in grades 1, 2, and 3, Title I students grow at a 
faster rate than similar Regular Needy students . In grades 4, 
5, and 6, the Title I students grow at 'the same raze as Regular 
Needy students . 

* r n math, for all grades from 1 through 5, Title I x students grow 
at a faster rate than similar Regular Needy students, / 

0 Title I students usually grow -at a rate that is similar to the 
rate of growth of Regular students. Nevertheless s the gap 
between Title I students arid Regular students 'widens as grade 
increases . It is shewn that this increasing achievement gap is 
to a considerable extent arti factual. 

The results of the three-year longitudinal study confirm the results for 
the first year. A number of different analyses shew that the less 

to 

disadvantaged Title I students benefit from a year of 7^ tie I services 
and are vrcmo ted out. Rcwev er } the mo st di sadvan taged s tude nts usually 
received Title I services during all three years of the study arid did 
not shew relative gains, but they did not drop further behind, perhaps 



:e cause of Title I 
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Sohoolj, pvinoivcil , and tecz*j!iey ofiar.iotevix'stijiS (an well ctii :>yu,.): i .> 
pi'cciti.joiij citiaoaisziuul with achievement* growth were ex-imined.. /"£ v,*:.: 
found th.it; 

0 Gveaiev ezrpez'ienae in teaafUng ia related to hijher student, 
growth in both reading and math, 

4 The amount of regular installation znd tutor/independetit uori\ 
shown ijtftffij positive j hut modeat^ effects on sahievemens gviwvh* 
In contrast^ the amount of instruction by special teaotiers or 
instruction in very small gvoupa doe si not often contribute $<j 
the explanation of achievement; growth^ and when these do negative 
relationships are observed* 

0 In both reading and math^ the disruption of instruction tends 
to be an unfavorable condition for learning in the uppev grides 
but not in the earlier grades, 

, 0 Frequency of feedback on student progress sometimes relates 
positively to reading and math achievement growth. 

0 In reading onlijj a teacher f s effort in planning and evaluation 
shows a positive relationshio -to achievement growth in same 
grades . 

School orincivals expressed a very vositive attitude toward CE. Teachers 
expressed both positive and negative attitudes . There was considerable < 
evidence that CE students had a positive attitude toward CE and did. not 
feel stigmatized. & 

We have new examined the questions of who receives compensatory education and 
what it is. We will now explore the evidence on the effectiveness of CE. 3ut 
be r ore we do so we should ask how we will judge CE 1 s effectiveness. What do 
we expect CE to achieve? Generally, students receiving CE are doing so either 
because testis show that their levels of achievement: are low or because teachers 
judge chat their performances axe low, or both, and it is judged , they would 
benefit from CE services. How much do we expect then to benefit? Scrr.e would 
say than if their performances improve at all then the cost of CE is justified. 
This is an absolute- criterion in the sense that we are simply asking for seme 
^improvement over the student 1 s ' previous level of performance. 3ut students 
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will grow in achievement even without CE, so we usually require that CS" 
result in an improvement greater than would have been achieved had the stu- 
dents not had CS. 3ut how do we tell how much the student would have improved 
without CE? We need some kind of a standard for comparison. With the use of 
a comparison standard the judgment of improvement has changed from a require- 
ment of absolute change to relative change. What is an appropriate compari- 
son group? Some will say that they would like CE students to improve enough 
to equal the performance of their peers, presumably meaning the average per- 
formance of the non-CE students in the school or class- This is probably an 
unrealistic expectation: soruG individual students may make such gains but 
not the average of all the CE students. 

Another comparison group might be composed of students who, in initial per- 
formance scores and home background, are similar to the students receiving^ 
CE. In this case we ask that those students receiving CE for a period of 
time show performance scores that are superior to the comparison group of 
similar students who have not received CE . Many would be encouraged if we 
could simply show some improvement relative to the comparison group even if 
it were not large. In theory it would be possible to form such comparison 
groups and after students have received CE services for a year or two to 
determine how much the CE students have benefited. In practice this is a 
very difficult thing to do. It will be worthwhile to understand why this is 
the t-vjse. 

The first problem is one of definition. In this c'rrster and in several that 
follow we present data on the relative per formancc- **; f groups of students 
that we call 'Regular Students,' 'Regular Needy Stuccnts, ' and 'Title I 
Students. 1 By Title I students we mean those students who are reported by 
their schools to be "designated to receive" Title I services- 'The amount of 
services varies from student to student as does the nature of the services, 
but, as we saw in Chapter III, these students as a group do in fact receive 
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more hours of reading and -math instruction in a different context than other 
students in the same schools. 3y Regular Needy students we mean students who 
are not designated to receive CE services but are judged by their teachers to 
need such services; in other words, they are receiving largely regular 
instruction even though they have a perceived need for additional services.* 
By Regular students we mean the remaining students in a school or class who 
receive regular instruction . It would seem that these groups of students are 
fairly clearly defined.** The group a student belongs to is fairly well 
defined at any one period of. time, but when one considers the progress of a 
student through severe! school years, the student may, from time to time, 
belong to all three groups. For example, a student might be a regular stu- 
dent in grade 1 and do rather poorly. In grade 2 the student might be judged 
as in need of CE but not receive any CE services because there are insuffi- 
cient resources available for this particular student. In grace 3 the student 
may still be educationally needy, there may be resources available, and the 
student may become a Title I student. Thus, in three years this student has 
been a Regular student, a Regular Needy student-, and a Title I student. Cr 
consider the student who performs at the 25th percentile on a test at the 
beginning of the first grade and is designated a Title I student. Because of 
Title I services this student's performance improves, and in the spring scores 
at the 35th percentile. Next: year in the second grade there are many needy 
students below the 35th percentile so the student is 'promoted out' of Title 
I. The student is still somewhat needy but not among the most needy and 
thus is no longer a Title I student. It is easy to follow the changing 



.'ill be remembered frca Chapter III that Regular N'eedv students actual iv 
receive more special services , than Regular Students but less than Title I 
3 tu caries. 



"Escape for the Regular students. In seme comparisons P.ecui 



all the students ir. a sc'r.ccl exeset far 



c; «<-« o n ** ~ 



s tucer. zs an 
,t cth6r t « 



.-..egu-Lar students are the students remaining after the CE students and 
Regular Needy student-; ere subtracted. The text will rh^e clear which 
definition is being used. Another group of students, not considered ir 
this chapter, are students receiving other -than Title I CE services . 
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classification of individual students, but in an evaluation of. the effective- 
ness of CE we are dealing with thousands of students in each classification 
and the change of students from one category to another makes the formation 
of proper comparison, groups extremely difficult. 

A HYPOTHETICAL EXAMPLE 

In this chapter, and in later ones, we will be presenting tables and graphs 
to show the relative achievement gains of different groups of students. To 
help in -understanding the meaning of these graphs and tables, and to illus- 
trate how they have been derived, we present a hypothetical illustration. In. 
the 1 Hypothetical School,' during the first year, there was only a single 
third grade class consisting of eight students. The left hand side of Table 
V-l shows these eight students and their fall percentile scores on an achieve- 
ment" test. Based on these achievement scores the school classified the eight 
students as follows: Students A, 3 , C and D were classified as Regular 
students. because they scored above the 50th percentile and were not in need 
of CE services. Students E and F, who had scores of 35 and 30, were judged 
by their teacher to be in need of CE but since the school has only enough 
resources for two Title I students, students E and F were classified as 
Regular Needy students. Students G and H, who had the lowest achievement 
scores of 25 and 15, were selected to receive Title I services. 

An achievement test was given again in the spring to the grade 3 students and 
the four- Regular students still performed well, with some improving slightly 
and some performing somewhat less well. But the two Regular Needy students / 
E and F, performed less well than they did in the fall and now have the 
lowest scores of the whole class. The Title I students, G and H , profited 
from their Title I services and registered gains, gains that placed them 
above E and F, the two Regular Needy students. 
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Table V-l 



Percentile Scores for Students 

Grade 


in the 
3 


Hypothetical School 


FaJJL 

Student Classification Percentile 


Spring 

Score Percentile Score ' 


A Regular 


85 


80 


B Regular 


75 


75 


C Regular 


70 


75 


D Recular 




65 


E Regular Needy ' 


35 


25 


F r Regular Needy 


30 


20 


G Title I 


25 


35 


H Title I 


15 


25 


Class Average 


50 


50 


Average fcr Hegular Students 


74 


74 


Average for Hegular Needy Students 


32 


23 


Average for Regular and 
Regular Needy Students 


60 


57 


Average for Title I Students 


20 


30 


Ail o f the students were prcr.c ted to the 


fourth 


grade and the right hand jar: 



of Table 7-2 shows the results for the second year. At the beginning of the 
year "he teacher was faced with a difficult decision- The Title I students, 
G and H, seem to have profited from their Title I services and were no longer 
the neediest students in the class. But if their services were taken away 
what would happen to their performances? Cn the other hand, the two Regular 
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Tabic M 

Percentile Scores for Students in the Hypothetical School 
Grades 3 £jH1 4 







Grade 3 






Gum 4 




Student Classification 


Tall Per- 
centile Score 


Spripg Per- 
centile Score 


Claaalflcfltlon 


. Fall Per- 
centile Score 


Spring Per- 
centile Score 


A 


Regular 


05 


Q0 


Regular 


00 


00 


1) 


Regular 


75 


75 


Regular 


75 


75 


C 


Regular 


70 


75 


Regular 


75 


70 ■ 


D 


Hegular 


65 


65 


Regular 


,65 


60 


E 


Regular Needy 


35 


25 


Title I 


25 


30 


r 


Regular Needy 


* 30 


20 


Title I 


20 


25 


G 


Title 1 


25 


35 


Regular Needy 


35 


35 


II 


Title 1 


15 


25 


Regular Hecdy» 


25 ' 


25 


Class Average 




50 


* 

50 




Crt 

50 


50 


Average for Regular Students 


74 


74 




74 


71 


Average for Regular Needy Students 32 


23 




30 


30 . 


Average for Regular and 
Regular Needy Students 


60 


57 




' ' 59 


J 

50 


Average for Title I Students 


20 


30 




'22 


27 



9 

ERIC 



170 



Needy students, £ and F , clearly needed Title I services and were now perform- 
ing less well than the Title I students. What to do? Facing the realities of 
limited funds, the two previous year Title I students had their services taken 
away and in. the fourth grade were classified as Regular Needy students. The 
two formerly Regular Needy students, E and F, now became Title I students. 
■The last column of Table V-l shows the performance scores at the end of the ■ 
fourth grade. it will be seen that the Regular students generally maintained 
their previous positions and the new Title I students improved relative to 
their previous position. The previous Title I students, G and K, who became 
Regular Needy students in the fourth grade , maintained their relative position 
and did not fall back as a result of losing Title I services. 



o note 

t3 



All of this is shown graphically in Figure v-l.. Here it is important t 
the relative slopes of the lines. During grade 3 all groups of student 
improved their performances, but the Title I students , improved at a consider- 
ably faster rate than the Regular Needy students and at a slightly faster 
rate than the Regular: students. During grade 4 all groups continued their .. 
improvements, with the. new Title I students improving at a faster rate than 
the now Regular Needy students and at about the same rate as the Regular 
students. While this example is hypothetical, in fact, Title-: students do 
tend to do somewhat better than a comparison group composed of Regular Needy 
students. Also, there is considerable change in status from one year to the 
next. . Of those students" receiving Title I services during a particular 
school year, about 40 percent will not receive Title I services the next 
year, and those who do not receive them because they were 'promoted out' will 
continue to perform at the now-higher level that causes them to lose Title 
services . / 
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FALL SPRING PALL SPRING 

. GRADE 3 . GRADE 4 

Figure V-l 

Gains In Vertical Scale Scores for Example School- 
Grades 3 and 4 (Hypothetical Data) 



ARE THERE ACK I EVEME ! 4 iT GAINS FOR TITLE X STUDENTS? 

The results reported in this chapter are based on Technical Reports 10 and 12. 
Report 10 thoroughly examines student growth as measured during the first year 
of the study, while Report 12 examines student growth longitudinally over all 
three years. An examination of student performance during the first year has 
the advantage of being based on the most complete data, since relatively iitcl 
student attriticn took place between the fail and spring testing of the first 
year. However, there was much greater attrition between the end of school and 
its beginning the next year for each of the three years. Two different studie 
of the effects of attrition are presented in Reports 12 and 13. It is gener- 
ally-concluded that while attrition was quite high the results are not jeopar- 
dized by it, Nevertheless, Report 10 is based on the sample with the least 
attrition and thus it was .desirable to study the first year sample intensively 
Another argument for studying the first year results carefully is that many 
students receive only one year of CE services and we wished to know what the 
effects of such one-year services were. Thus, we first present the results 
from Report 10 and then consider the results based on the three year longitu- 
dinal data. 

ACHIEVEMENT GROWTH BASED ON FIRST YEAR DATA 

The basic results of Report 10 are shown in Figures V-2, 7-3 , 7-4, and 7-5, 
The first two figures show the results for reading, with the first figure show- 
ing the results for grades 1, 2, and 3 and the second figure shewing the re- 
sults for grades 4, 5, and 6. V/e have chosen to use two' graphs to show the 
results in each subject because it makes the presentation less complicated. 
(We could have shown the results for six different groups cf students, but the 
number of lines crossing and occupying nearly the same space would have confuse 
the picture.) Thus, each, graph shevs the results for Regular students* (in 
Title I schools), for Title I students (in these same Title I schecis) and for 



These Regular students include the Regular Needy students. 
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1.1 1-3 2.1 22 3.1 

GRADE 

Figure V-2 



Reading Vertical Scale Scores, for Title I, Regular Needy, 
and .Regular Students in Grades 1, 2 and 3 
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SOUHCE: REPORT 10, TABLH5 B4-1 AND B4-3 
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500 



450 




T1TLH I 

— NEEDY 

— REGULAR 



4.1 4.3 5.1 5.3 5.1 

GRAOg 

Figure V-3 . 

Reading Vertical Scale Scores' for Title I, Regular Needy, 
and Regular Students in Grades 4, 5 f and 6 
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SOURCE: RtfORT 10, 7A0UE5 B-*-1 AND BA-3 
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Figure V— 4 



Math Vertical Scale Scores for Title I, Regular Needy, 
and Re<rolar Students in Grades 1, 2, and 3 



3-8 



ERLC 



V-13 



17 



S 



\ 



SOUMCS; HlL?ORT 10. TABLES B4» 1 AN O 0-4-3 




4.1 -4-3 5.1 53 6.1 63 



Figure V-5 

Math Vertical Scale Scores for Title I, Regular Needy, 
and Regular Students in Grades 4, 5, and 6 
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Regular Needy students in schools not havi: q The choice of this last 

group as the comparison group is somewhat arbitrary. We ccuid have chosen 
Regular Needy students in the Title I schools, but there are two drawbacks to 
using this comparison group. In the first place, these students are needy, 
but the school authorities have decided that they are not as needy as those 
chosen for Title I services, and thus they differ from the Title I students. 
In the second place, there is the problem of the "spillover effect" which 
might contribute to all students in Title I schopls but particularity the 
Regular Needy Students. This is the problem that the instruction in Tivle I 
schools may affect all the students in the school, not j use > the Title I 
students. An examination of Report 10 will show that the results for either 
comparison group lead to the same conclusion. 

An inspection of the figures shows the results of the analysis, but such a 
presentation is not adequate for those who require statistical tests. First, 
it should be mentioned that the backup numbers for these figures will be 
found in Table B4-l.and B4-3 of Report 10. The approximate number of students 
in each grade for Regular, Title I, and Regular Needy groups in reading are, 
respectively, 6,400, 2,600, and 600. In math the approximate number of 
students is 7,500, 1,500 and 1,150.. The exact numbers differ from grace to 
grade. The larger numbers of Regular and Regular Needy students in math is 
related to the fact: that Title I math programs are less common. The main 
point of the above is to s"tress that each data point is based on a large 
number of students and thus is quite stable. 

Figure V-2 shows that for reading, the Title I students in grades 1, 2, and 3 
grew at a somewhat faster race than the compariscn group of Regular Needy 
students. All groups of students had educational growth during the school 
year. In each grade the Regular students started out at higher levels and 
ended the school year at higher levels. In grades 1 and 2 the Regular* stu- 
dents grew at slightly faster rates than either the Title T or the Regular 
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Needy students. In the third grade the Title I students grew at slightly 
faster rates than the Regular students. In each of the three grades the 
Title I srudents grew at rates higher than those of the comparison group or 
Regular Needy students. We conclude that in readinr for the first triree 
grades students receiving Title I services show improvements greater than v 
would have been the case if they had not received th£ Title I -res. At 

th* same tine the amounts of improvement are not great enough . row the 

'achievement gap 1 between the Title I students and the Regular students. In 
fact, the gap is becoming larger. 

Figure 7-3 shows similar data for reading in grace? 4, 5,, and 5 . For these 
grades there do not seem to be beneficial effects from Title I services. How- 
ever/ the rates of growth for all three groups appear tz be the same. In 
spite of tl-is apparently equivalent growth rate the gap, between the Regular 
students and the other students, continr.es to grew. This growth in the 
achievement gap is something of an artifact since the composition of the three 
groups keeps changing from year to year, as it must in a cross-sectional com- 
parison. The better Title I students and better Regular Needy students keep 
being promoted out jf the bottom groups as their achievement scores improve. 
In any grade, at the beginning of any year (after the first grade) , the 
Regular group is composed of the relatively high achieving regular students 
oius the better achieving- Title I and Regular Needy students from the previous 
year. At the same time the Regular group loses its poorest students to the 
Title' I and Regular Needy groups, who have % in turn lost their better students 
and had them replaced by poorer ones. Thus, it is almost inevitable that in 
cross-sectional data the gap between Regular and Title I or Regular Needy 
students appears to widen as grade increases. Another contributing r actor ;.s 
that the absolute number of Title I students decreases at the higher grade 
with the result that the average achievement level of Title I students in the 
higher grades is lower relative to that in the earlier grades. This is true 
because the most needy students are being selected and since fewer are 
selected in the higher grades they are the lowest of the lew;. In summary, 
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far reading, Title I seeps to be somewhat effective in grades 1, 2, and 3, but 
not effective in grades 4 , 5 , and 6 . ~ ^ 

Figures V-4 and V-5 show the results for math. The results here are more 
positive than they are for reading. They show that for all grades the Title I 
students improve at a faster rate than the Regular Needy students. Further- 
more, the Title I students in math improve at faster rates than the Regular 
students while the Regular Seedy students change at slower rates than the 
Regular students. It seems quite clear that Title I is effective in math and 
considerably more so than in reading. 

An explanation- for this may be the difference in the way reading and math are 
learned by students. Reading is learned in school but also in a number of 
other settings. There are opportunities to learn reading at home from many 
sources,, such as comic books, regular books, newspapers, instructions on toys 
and packages, and also away from home on posters, advertisements, in Sunday 
School and in other social settings. On the other hand, the opportunity to 
learn math is much more .limited. Outside the school there is seme' opportunity 
to learn math in changing money, in sports in keeping score, etc. but such 
math is quite simple and generally does not increase in complexity with the 
increasing age of the student. Thus, the school is the ma^ place where math 
is learned, and it seems apparent that the additional services provided by- 
Title I to math students result in increasing their levels of achievement. 

The four figures showing graphs achievement change give the basic results, 
but the* technical reader will want to refer to Report 10 for the detailed 
statistical analysis. In describing the methods used in analyzing the data, 
Ming-Mei Wang, the senior .author of Report 10 says: 

"Five types of evaluation models -are employed that are related to 
the models required by the Education Department for use by grantees 
in evaluating and reporting on their local Title I projects 
(45 CFR, Parts 116 and 116a). The large SES samples provide us 
a unique opportunity to apply a variety of methods that require 
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different subsets of data to address the sane question. Briefly, 
the norm-referenced analyses are variations of Model A ( non- 
referenced design) . The" analyses of variance (A2J0VA) with dif- 
ferent layouts and different measures of grovrth, and the analyses 
of covariance (ANCOVA) using different analysis groups and ad- 
justed for unreliabilities of the covariate (pretest score) are 
designed to address the cases of Model 3 (control-group design) . 
The comparison of gains conditional on pretest: scores is a devia- 
tion of Model C (special regression- design) , Additionally, the 
comparisons with expected growth represent a blend of Models 3 
and C where regression-based prediction models are employed to 
mimic the performance of a control group that is like the treat- 
ment group in pretest scores and other relevant characteristics. 
The analysis of each design further encompasses a class of -sub- 
analyses. All the analyses are devised to complement one another 
so that pitfalls in one may be avoided in another. In the end, 
we hope that the integrated findings from these different 
approaches will approximate an accurate evaluation." 

The different analyses xentioned above were carried out and are contained in 
Resort 10. They essentially confirm one another and indicate the statistica 
soundness of the conclusions previously stated, namely that Title I does hav 
a positive effect for reading in the 1st, 2nd, and 3rd grades and in all 
grades for, math. 

ACHIEVEMENT GROWTH 3ASZD CM THREE-YEAR LONGITUDINAL DATA 

Recort 12 presents the results of analyzing the three-year longitudinal data 
from a number of different points of view. Seven different: approaches were 
.used in examining the data. Each one used a somewhat different set of 
assumptions regarding the appropriate groups for comparison purposes, or the 
method of handling the initial differences in achievement levels between the 
groups, or the expected rate of growth between the different groups dependir. 
on their initial level of achievement, or the amount ar.d time oz participate 
in Title I. In Report. 12 the various statistical tests and descriptions cf % 
the assumptions underlying each approach is given in detail. Irrespective 
of the method of analysis used, there is one common conclusion, Sanely: 
carricirration in Title I has a modest positive effect. on achievement growth. 
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In this report we present the results from three of the analyses which lend 
themselves tc graphic presentation. The statistically minded reader will want: 
to turn to Report 12 for the detailed analyses, hue it can be stated generally 
that nxosz of the differences reported here are statistically significant. 
Since the number of cases on which the various data points are based is quite 
large it is fairly easy to get statistically significant differences. The 
more important question is the practical significance or importance of the 
differences shown. After the results are shown we will have more to say on 
nhis point. 

Results for jtudq n^s Who Par ticipated_ f or Different Lengths of Tine , Students 
Participate in Title I for different lengths of time. In this study some stu- 
dent;^ cartic: pa ted for only one year, some for two years, and others for all 
thrae years. The reader's first impulse is to assume that the students who 
participated the longest would shew the largest ga'ins. Butua little thought 
will sh'W-that this is rot. the right expectation. As we mentioned in the 
introduction to t!iis chapter, students enter and leave the Title I program 
continuously, particularly at the beginning and. end of the school year. The 
hunter student-, who" have profited the most. I.rom the Title I experience are 
•promoted ou~'' axd students who were* net in the program but performed poorly 
during the previous school year replace them. W*» will see that the students 
who stay i.n the program for throe -full years are those who start with the 
lowest achievement and do not gain er^ugh to come. to the' level of those who 
are leaving the p- agraxru ::ausj we must examine th* performance of the students 
at a detailed lev^l which considers their initial per Trr-nai. -e and subsequent 
grewth- 

* Figure V-6 s'r;wa the relative growth of regular students, students who have 
saxticiaateO in Title I for one ..year only, and students who have participated 
in Title ? during all three years of che study. The results are shown in 
terms of 'standardized achievement scores 1 which means- that for each testing 
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in each fall and spring far each of the years, a. separate standardization was 
rrorformed 50 chat the mean for the total population of students' tests is 100 
.uid the standard deviation is 20. Thus, the trends in the graph show the 
relative rates of performance change, of the students one to the other.* In 
examining Figure V-6 it should be noted that the regular students start; at a 
level somewhat higher than the mean and end up the school year at approximate! 
the same position. (This does not mean that the students did , not learn during 
the school year, rather it shows that they retained their same relative stand- 
ing.) Looking at the students who were in Title I for only the first year of 
the study we see that they started the year considerably ' below the regular 
students and generally a little below the average for all the students* In 
every case these students improved their relative performance and in four 
of the eight comparisons ended* the school year above the average of all 
students. This marked gain is true for all four grades and for both math 
and reading. 3ut we should remember that these students started out at a 
fairly high level and were the students who could probably profit most from 
extra instruction. In examining the lines for those students who were in 
Title I for all three years of the study we see a quite different picture. 
These students start the school year at a relatively lew level of achieve- 
ment, about one standard deviation below the meSn , and co not profit much 
from their Title I education- In reading there is a slight .improvement in 
relative, standing in two of th"*. grades but losses in the other two grades. 
In math there is seme improvement in three of tne grades and a loss in c to. 
It can be seen that the amount o£ gain or loss is fairly small and is never 
as large as the gain made by the students who participate only one year and 
are then 'promoted out'. It should be noted that regression effectc should 
be strongest in the lowest achieving groups, yet they are the ones tha~_ 

Actually the standardization was done on the total peculation of students 
tested and the graphs do not include the students^in compensatory education 
programs other than Title I, nor those with ot b^r combinations of Title I 
experience. .Thus, the' sum of the gains and losses for the graphs are. not 
exactly the sane, even though they would be for the entire papulation tested. 
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have the lowest: gains and thus the difference between the two croups cannot 
be attributed to regression, Similarly it can be argued that mnturati-n 
effects do not account for the differences since the graphs are based cn 
relative change and not absolute growth- From this data it is apparent that 
those participating in Title I for only one year show a quite positive growth. 
On the other hand those students who participate in Title I for three years 
show little growth and it may be inferred that Title I, at its present level 
of intensity, is not very helpful for the:; 

Results for Students Who Par ticipated at Different Time Periods or Different 
Lengths of Time . In this section we will examine the results for students who 
participated in Title I during the first year of the study only, for -hose who 
participated during the second year only, and for those who participated for 
the third year only. We will also examine the results for those who partici- 
pated for more than one year but with different periods of participation. 
^ Figures V-7 and V-3 show the results for reading and snath. Since the results 
for reading and math are quits sir:, l^.r we will discuss the two figures simul- 
taneously. First we should note ch^.t the regular students retain their rela- 
tive standing thoughout the y^ars " the study. They are well above average 
of ail the students, although' the math students are not quite as much above 
the other students as aire those in reading. The next group is those students 
who were in Title I only during the first year of the study. For both reading 
and math they make quite large gains, improving their relative po sis-ion about 
three and a half points. In reading these students maintain their gain in 
relative achievement but in math they tend to lose it over the next two years, 
but they are still above" the other Title I students . Next:, noV^.sa the curves 
for the students who were in Title. X only during the second year of the study. 
During the first year of the study they tended to icse relative standing and 
were selected for Title I during the second year. For both reading and math 
sinahie gains were made during the second year while they participated in 
Title I. During the • third year thev tended to lose their relative cc si tier. 
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Figure V-7 

Patterns for Title I Participation for Reading 
Data from Report 12, Table C-l- 
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when they wore not in Title I. Next notice the Lines' for those who wore in 
Title I only during the third year of the study. They were not selected for 
Title I during the first or second year of the study and tended to lone in 
relative standing in each of these years. But finally in the third year they 
were selected for Title I but show only very modest positive effects of the 
Title I participation, although their decline of the previous years was halted. 

Mow, we will examine the performance of those who were, in Title I for more than 
one vear. The next curves show the performance of those who were in Title I 
during the first and second years of the study. It will be seen that in both 
reading and math, they started the school year at a score of about 35 and 
gained three or four points. Again during their second year of Title I parti- 
cipation . they improved significantly but then in the third year, when they 
were no longer in Title I, thiy show a. decline. Next consider those students 
who were in Title I during the first and third year but wore not in it during 
the second year. During the first year they improved. at about the same rate 
as the other first year Title I students we have considered so far, but by the 
end of the second year they had dropped considerably and were below the stand- 
ing achieved wh«n they started the first year. Again they were placed in Title 
I during the third year and .show improvement for that year. Next: there are 
those who participated in Title I during the second and third years of the 
study. At the end of the first year they were quite low, about 32 or 83, and 
were placed in Title I during the second year, where they stop their decline 
or make" slight improvements. Because they are still quite low, however, they 
are placed in Title I during the third year, and in bath reading and math they 
show. relative gains- Finally there are those students who were in Title I 
during all three" years of the study. After three years of Title I participa- 
tion they are in the same relatively low position as they were at the beginning 
of the study. 
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In reviewing thv*.»'.: result:; t:ho following pic tut" a jnooinri t.*. > .'ino:: go . 



Vho .VL-vjU.l, -i 



high scoring student:; rotain their rolativuly high 'Standing v/i-h^ur. anv comfvvw 
satary education. Those studowts who scoro soraowlut ] . -:tr th.m r^gul^r stu- 
dents but are still not greatly disadvantaged, but ace nevertheless selected 
for Title I during the first year, show marked gains during the first year and 
are 'promoted out' of Title I. Student! who received Title 1 during the second 
year, but not during the first year, also show good improvement when they are 
in Title I. Throughout, w^ see that students with relatively high standing 
improve the most during the year(s) they participate in Title I. Those with 
relatively low standing who do not participate in Title I, tend to lose in 
relative standing, but when they are assigned to Title I, their loss is 
arrested and' they may show some improvement. Finally the students who start 
the lowest, remain. the lowest even though they participate in Title I. It * 
seems that the better students profit the most from Title I. The poorest 
students do not gain from participating in Title I but they also do not fail 
further behind, as .right be their fate had they not been in Title I. This 
can be inferred from the performance of those students who w ere relatively 
low during the first year and did not have Title I services . 



growth of students who participated in Title I for various periods of time and 
had varying amounts of service. In this. section we use a different approach 
by comparing the performance of students who were, in Title I with the per for - 
mance of students who received regular education in their classes but whose 
teachers said they needed compensatory education. The teachers made this 
judgment in the first year of the study and we have continued to, use that 
judgment thorughout the study. Figures ■ V-9, 7-10, and 7-11 shew -r.es a com- 
parisons. , Locking at Figure 7-9 we sea -the results for studer.os who partici- 
pated in Title I during the first year of the study only. (In the fig-are a 
cox has been drawn around the lines for the ^irst year.) It. will be seen that 




Co mparing Title I Studento With Needy Regu 1 
sections we have studied the effects of Tit- 



tvdents . In the two previous 



,y examining the relative 
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Figure H 

Title I Participation During First Year of Study 
(Data from Report 12^ Table D~2), 
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Title I Participation During Second Year of Study 
(Data from Report 12, Table D-l), 
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Figure HI 

Title I Participation During Third Year of Study 
(Data from Report 12, Table D-3). 
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the Regular students, in both reading and math/ retain their relative s::.:tn<!:n 
from the fall to the spring. Well below the Regular s tuderits are the T:. tie !. 
students and the Needy students who start the fall of the school year at ::v;cr. 
the same level. It will be seen that for both reading and math the s tudi! ;it:.r. 
who participated in Title I gained relative to both the Needy students and t:h 
other Regular students. The gain in math is larger than it is in reading. 7 
figure also shows the relative performance of these same students during the 
subsequent two years of the study. There is very little difference in the 
curves for the Title I students and the Needy students in the later years. . 

Figure V-10 shows the results for students who had Title I services during th 
second year of the study only. It will be seen that the Title I students in 
reading improved significantly relative to the Needy students and* that they 
mace a small improvement in math- Figure V-ll shews the results for those 
students who were in Title I only during the third year cf the study. Again 
it 'Will be seen that the Title I students improved relative to the Needy stu- 
dents in both reading and math, although the improvement in math is larger 
than it is in reading. In all six comparisons shewr. in these figures , the 
Title I students show improvement relative to the Needy students, although th 
improvements tend to be modest.. 

As previously mentioned,. Report 12 contains a number of other analyses that 
aire not presented here because they do not lend themselves to readily under- 
standable graphic or tabular presentation. However, the results are all con- 
sistent in showing that Title I. participation is associated with increased 
relative growth* The results are statistically compelling, but to seme e:< ten 
this is because cf the large number of cases in the study. The practical 
importance of the" improvement associated with Tirle I is a matter cf educa- 
tional judgment. Seme have argued that ecmper.s.- -cry education should bring 
disadvantaged students up to the level cf their peers , presumably meaning up 
to the average cf ail the students- This is a very unrealistic expectation. 
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Sfcudanta entering school diffe-r widely in achievement buLh ^.)Ouus.' of \:.\v..t\ v 
native ability and because of their preschool experience in roadincj an. I m.-tt:h 
Our results show that Title X , as it is now practiced, can result in an 
improvement of four or five points on a standardised scale for those student 
who are initially only modestly disadvantaged. Title I. can keep quite dis- 
advantaged students from falling further behind but it does not improve thei. 
performance relative to regular students. Some have said that any improve- 
ment of disadvantaged students would be worth the cost of Title I. If this 
is accepted, then Title I has served a useful purpose. 

Other M easures of Title I Effectiveness . When this study was started some 
critics of educational testing argued that standardized achievement tests 
were an unfair measure of the performance " of disadvantaged students. Others 
argued that while achievement measures might not be effected by compensatory 
education, the students 1 attitude toward school and their peers would be 
improved by compensatory education. With these thoughts in mind we develops 
a 'functional literacy' test which was thought to measure the students' 
ability to deal with everyday problems, rather than with simply school-type 
academic problems. We also adopted a measure of attitude toward school, and 
toward self as a student. The results from both of these measures are repc; 
ed in Report 12. Generally there is no relationship between Title I and p-?r 
formance on these measures. While there may be certain problems with stan- 
dardized achievement tests, they proved to be more sensitive to the effects 
of Title I than any other measure we. used. 

TEST — CURRICULUM OVERLAP 

As* has been mentioned there had been criticism of standard achievement testis 
as the measure of student learning. In response we developed a measure of 
'functional literacy' as an alternate mearu-e of knowledge, but we also 
investigated the extent to which the mater -1 contained in the standardized 
tests had been taught to the students* In connection with the study of hi, r '.i 
poverty schools we asked teachers to examine each of c*ie items in the achiev 
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tmnt k£\'i\£ cjiviin thou: li r.:vii.Ir"sn t:.i aiv.l t.M J :k _ 1 l.cit-u i.r 7 50 t-ur^tjat: or jnoro r.h'ii, 
iitudouta had ro<.:'o i.vod at b-ta.:.t ttii. ni:aa L instruction :roio.va:\t; t;.« u.vjh itvru. Wu 
thon compiled thasn roauLfcn for ro' ; ;uLu: utud-iiits and nor Law ;i.:h living litu- 
dunts (who woro dafincsd a a falling at*, or holow tho 33rd po.i;c:ant:.i.lo) « T^ibLo 
V-3 show::* the amount of judged test-curricul.utn ovorlan for regular and ( low 
achieving students . 

Table V-3 

Mean Student-Level Percent Overlap for Regular and Lew Achieving Students 



Lew ■ Achievers 



Recular Achievers 



Grade 2 



Reading Vocabulary 
Reading Comprehension 

Math Concepts • 
Math Computation 



Reading . Vocabulary 
Reading Corner eh ens ion 

Math Concepts 
Math Confutation 



75 
69 

80 
65 



73 
78 

75 
86 



Grade 5 



88 
95 

91 
83 



86 
93 

82 
91 



(Source: .Report 19, Table 4-14.) 



It will be remembered that in low achieving classes we administered a form 
of the achievement test that was one step lower than that recommended by the 
test publisher and this was the test the teachers judged for the low achievers, 
Nevertheless it will be seen that in each case the teachers judged that the 
low achievers had a smaller likelihood of having learned the material than 
had the regular students. There are several points to be made regarding 
these results. First, the differences between the amount of overlap in the 



second grade and the fifth grade favcr the f i 



ace . 



Second, the amount 



of overlap reported here is considerably higher than has been reported in 
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othui: ;M:udt,.i8i (uou Cooloy (fl) ,uui L.;iniurt, 20), Third, w » wnuU L .>r r ..>r; r. 
higher aduoviiu] ami more ab.U HtudontiS to Iuivm covorod uku'u at; i/,h«! m.ii.*...! r ia I 
than would tim law aohioving student::*, aimply bocaui.o tho hi.gh acluravirwj 
studonta cov«r mora matar.U.l in tho course! of thoir instruction. Finally, 
gains in achiavamant wore related to tlw lava! of material oach student wan 
tasted on, from one toat administration to another. Since then* is a vary 
high car-elation between achievement scores from teat administration to test 
administration, we can bo quits sura that students wore taking tost* at the 
same relative level, and thus their gain scorer, would bo comparable, Thu.;, 
we believe these results , while interesting, do not in any way invalidate the 
results previously reported regarding achievement gain. 

PRINCIPAL'S AND TEACHER'S ATTITUDES TOWARDS COMPENSATORY EDUCATION 

As researchers we place great emphasis on the objective, test-based evidence 
regarding the effectiveness of CE. At the same time, it is important to con- 
sider the attitudes that principals and teachers have toward the program. If 
their attitudes were negative w,e might argue that the program was being half- 
heartedly administered. On the other hand, if the attitudes were positive, 
it might imply that- our results ■ reflect what might be obtained from a well 
administered program. In the study of high-poverty schools both the principals 
and teachers were interviewed in depth to determine their feelings about the 
compensatory, programs in_ their schools. In general, it can be. said that the 
principals had a very positive attitude about the effectiveness of the pro- 
grams. Table v-4 shows the principals 1 responses to a question about the 
effectiveness of their CE program. 

Three principals accounted for the lowest two ratings for reading and math. 
The principal who rated both reading. and math programs low in effectiveness 
had extremely minimal Title I reading and math programs at his school. Thus, 
it can be seen that at schools where there, were significant CE programs the 
principals rated them from fairly effective to rvery effective; indeed, they 
rated them as more effective than the objective facts would justify. 
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Tahiti V-4 



Ris.-icllnn Mj}£h 



3 
n 

i 



Very effective 



ilot effective 



27 
40 
29 
4 

0 



32 
30 

5 
0 



(Source: Report 13, Table 5-1.) 

The principals were also asked about what effects the CS program night have irj 
areas or.her than reading and math. In reading, over 90 percent of the prin- 
cipals believed that CS programs had beneficial effects in other areas and in 
math over two-thirds cited beneficial effects in other areas. Among the bene- 
ficial effects cited were: beneficial effects in other academic subjects, 
improvement in self-concept and self-esteem, improvement in motivation or 
attitude, multiple teacher exposure, and improvement in logical thinking. ^ 
Practically.no one mentioned sigmati tation , but rather the reverse, a pride in 
being singled out for special attention. The vast majority of the principals 
felt that the CZ programs also had positive effects on the pupils, who were not 
participating since they" freed' up" additional teacher time Jos regular students. 



While principals' attitudes toward CZ were quite positive the attitude q: 
teachers was more mixed. A number of teachers nctad. the dec .r. of many CZ 

teachers and cited instances where they had cue in extra time :r spent their . 
own scr.ey to buy supplies or gifts for the children. These teachers also noted 
the -additional assistance they received from CZ staff members in handling slew 
learners and in helping in C cai tasks. But a number of teachers cited 
negative aspects of the prcgr^a such as disruptions in the class associated 
with pulling out students and sending them to special rccms 
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•-JU i'lfi I. Luti.-i wh«iii thi.iy uii.iil" TiT-Ln ! :iupp .1. 1 ..^» , i u - . i: vii..m: i ..in.il mm i .1 L; , ..u- .-(uir • 
moul: cut: f.hn unlilro im!;!i«m: than J U:.i L for t}).! c.':H du-.i i.- jn-n i:.ti. 1 .:liilU«'U f 

Th'.w.'u wur.'ti al.-io a numb.ir: «:w. : .\i.lml.n.l:it-.M»;l.vo pr.-ihlrj^^ ciU/nd. ru Lj-iifui r/.-i 1. Llui 
fcn.ialvu:' m n.j»j,U'.l.vo fun Uu> vmi:u a m moi.;.1 .i t:>.i.1 with adm.l.u 1. :jt r.u. i v» » nt.^hlumi ai: 
thu linMl rur' 'school Lovul , 

Finally, wo a stomp toil to 'jathov ;joiuo Uw.l Uml i.. >n or: how l:h<i tiu-Uinf. .s :;<;!.•: .i!iour: 
CK pivji-j:: ih\:: . Wo did not: ta.U; to r a tiLU'lo nc:i ■ I »•■•«■•! l.y ahout k\v.\ p r,i.;>: .un:s i.nr: wu 
r ;ho ob.;or\\!:: 1 ..i ropo j: h :.. i m\ .\ :;V.»und i .-■ i nd i. : \ : *n , :>.••' ,'Ml-r.". 

at titudo . 

In reading the Classroom Qualitative Summaries only thro a statements refloating 
unfavorably on pullout lab situations woro discovered. In ono instanco--and 
one of the few instances that hinted at s tigmatization — the .observer reported 
that several students expressed resentment ■ at having to comti to the CE lab. 
The immediate stimulus for their comments was the fact that they had been 
forced to leave the regular classroom while a party was in progress. In the 
other two cases, students stated to the lab teachers that they were bored with 
the -work assigned. 

On the positive side, one observer described a situation *in which children 
requested extra time in the lab for further work: on their individual difficul- 
ties. Another described the eagerness of the children, and still another 
related that children "applauded and cheered one another for specific achieve- 
ments in the lab. 

Some 13 expressions of positive attitudes toward pullout labs were compiled 
from school-level daily Topical . Summaries for 12 different schools. Thr- 
following are .selected quotes from those orotccols. 
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M .V:i.:iu:-.li.iw ta t"!u'. r: I *-. n. i 1 1: .u\-\ .i-' i»u : a;: lIks V t-M-! i" r. :■:■;..! .; , i. 
,->;:" r.liM .::l|i.!..h::tn JM.n-1 i:ha j*[::..im . : .a t:ii> -y r:.h--i!. !■ -n't v. - 

tvi !.r«..iv^ i f w t- ha i -'a< w.d i ii.u.. .r na i I '.hi*.: :i'a^ avi:!. h»: i :. i -.: |.v=-r i ■. m a. 

v/ii«ira i.hillvf:!! h.ul .a.' i r . : t - \ thar Lh.sy v/.iaf-.! 1 i < t^.j/ly . a .1 
luu^ni.-i.-t k\v\\* ullvln't.: wanr. r;a /pit. our. .w J t>\«- MM. r.: Ln i. r- r - j r . 

M :] ta h Imj\ t u :i«uu;\'wl to onl^y .annuvj to TULn r i.-n.ul |.;vi .»n-l lu.i'h 
t\\i\\\ on' t!\a vnijul.-i!,' ta.M^h'HM nun l,:iSus« I # -i\tt rirauliur-..-, !-y a^a. 

bir.i'.hi'/ ulu'un -° Vt.tLa t o LiaaaM . 



";<ida m»m:»'.;i to aujoy tho«\fi»ilv«in Ln tl\a pr'>j;:.»m . »• m i wi. 

f.;) bu r»"s Luc tan t to n r.on cMaui.i and !.m:,M bane/, r'-ii: Imh'-. 
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"Tha c:t:.mp»»n:.iav..',ry m hy.'a t ! on tM.uV.iM r." ■ihav: r-. 1 1* t • ? i\ - ; .y -T. J "*y 

b.jin<j in tha 'V^acial ultivj CLaa.-i , " ^ r;o r; v/J^a'..; : to ;;«•:: 

and a:-;k how Co got in." 

Also rolflvant to thin topic are the obsitirvacionii or: Ait fer^nooa in pv.rfor;;uii<.:o 
and behavior of students in the regular and pullout clanarsama . In the Clana- 
rocm Qualitative Summaries, sight observers in seven different schools re- 
marked that students observed with hohavior or performance probl* ;n?J in rogal.i:: 
classrooms did not show those same problems in compensatory classes. On the 
contrary, they were involved and on- task . Looking at the reverse situation, 
protocols for two regular classrooms included an explicit statement by the 
observer that the overall behavioral and on-task picture in the ciassreen 
improved markedly when the served students left for puilout lab, 

WHAT EDUCATIONAL PRACTICES ARE ASSOCIATED WITH TITLE I EFFECTIVENESS ? 

We have shown that Title I is effective in increasing the performance of low- 
achieving students. We would like to be able to shew that certain educaticnal 
practices, principal and teacher characteristics, and methods of ciassreem 
organisation are related to this effectiveness, so that the useful cr.es could 
be more widely adopted. Therefore, we explored a number of these variables. 
We investigated the relationship of the follcwing to increased achievement: 

o Instructional ser/ices such as the .T^er of hours of Instruction 
and the. costs of that instruction. Also, such factors as the amount 
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;\l.:iO, Wh«U:|utr t.l\«i UUtrUOr, ion w.i, oiVtUI lit I'iiM v/ImIm ■ : I \ , : ■ .. -mi i-H'i:]., 
l.M =iUM I. 1- ■J!.'OMp:.i , Of thr^U-jh in 1 1 V L ll U I 1.(1 ..; I.; I • ' |..|\. 

fc * ' - v. t ?. i' ,,, >t! , :.v or t.h^ in , ': • u : »\ i i ! i:. -u? „i | ,, , 

to.wh UVJ >i;([ii)r um,:i.i , amount; or ool ksiju j.-.-i Ln Livj , .imonnt i:" \ 
U'aLnUvj, and at i r.udo toward t !\«« riojiool, |, n,v>«p' 

« Chiir.vwturLatlcii of tho ndiu.Mt lon.il '.wv/ironrn'MU;. .'inch t:i tho school 1 .-; 
minor Lty concwit ration, nchool'u Cfi coiunrntrat i on # district.' control, 
of instruction, principal's inLitru- t.i onal I.is..nlocnhLp , and amount; nc 
c 1 a 3 :,i room d i fc u r bu n c o u , 

a charactorlatica of educational practices :;uch am t!u> amount: of 
effort: devoted to planning and evaluation, u:iis of laurson p.Ltns, 
frequency of feedback, amount: of homework, individualization of 
instruction, and uso of audiovisual aids. 

Tho effectiveness of these variables was explored L / i number of different 
techniques, such as regression analysis and causal viodoling. Generally the 
results were disappointing in the sense that there were no strong relation- 
ships between any of these variables and increases in achievement. There 
were jome relationships that seemed to be significant but they were not strong 
The most noteworthy findings were: 

o Greater experience in teaching Lr> related to increased student crowth 
in both reading and math. 



ERLC 



V-37 

2oi 



« The amount of; regular instruction and tutor/independent work, shews 

. sctae-oosi-tiv.3, -but modest, effects on achievement growth. In contrast, 

amount of instruction by special teachers or in very small groups dees 
not often contribute to the explanation of achievement growth, and when 
it does, a negative relationship is observed. 

• In both reading and math, disruption of instruction tends to be an 
unfavorable condition for learning in the upper grades, but no relation 
ship is found in the earlier grades. 

• Frequency of feedback on a student's progress sometimes relates 
positively to reading and math achievement growth. 

o In reading, a teacher's effort in planning and evaluation shows a 
positive relationship to achievement grow-oh in scrr.e grades. This 
relationship was not found for math. 

in summarizing this chapter it can be said that there is evidence that Title I 
services are positively related to achievement growth in reading in the first 
three grades and that Title I services are positively related to achievement 
growth in aiath in all grades. As just discussed there are seme educational 
practices that are positively related to achievement growth. Students who 
receive instruction from rr.ore experienced teachers profit more than those 
receiving instruction from less experienced teachers. Also, instruction in 
the regular classroom setting seems to be a positive factor as dees receiving 
instruction in a setting without disruption. 

From. a practical point of view one implication of these findings is that Title 
- services should be increased so that they are available to ail needy student 
Since only about half of all needy students are new receiving Title 1 services 
this wculd require a very large increase in the amount of Title I funding. A 
political judgment is required as to whether the amount of gain is sufficient 
to justify this increased funding, but it is clear that many children who 
could profit frcm Title I services are not receiving then. 
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CHAPTER VI o HOW COST-EFFECTIVE IS COMPENSATOR'/ EDUCATION? 
Summary 

In CE programs it is usually assumed that as the cost of the resource 
increases j there will be a corresponding increase in the growth of 
student achievement. This assumption is basic to most federal 
education programs * To test this assi<mptionj a "resource •• cos z " model 
was developed that allowed us to examine the relaoionshiv bcrwecK 
instructional costs and achievement growth. The results were rhat: 

# There is no demonstrated relationship be owe en the 

costs of the instruction students receive and changes 
in academic achievement. 

It has consequently been argued that this finding can be explained 
by the fact that the least able students receive the most costly 
services j and they are also the ones' that are least likely to 
improve academically . This idea was tested and it was found the z : 

0 The cost of instructional services received by the 
least able students is higher than the cost of in- 
struction for more able' students * 

This second finding offers some explanation for the lack of relation 
between instructional cost and achievement growth. When coupled with 
the findings reported in Chapter 7, that the least able CE' partici- 
pants profit the least from their services^ we understand the nature 
of the conclusions to the issues of cost-effectiveness > An under- 
standing of the dynarrrlcs underlying the conclusions is necessary for 

policy makers to make rational policy decisions. 

<• 

INTRODUCTION 

It seems reasonable that as more and more resources are made available for 
the instruction of low-achieving students , the achievement of the students 
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should . increase . One of the assumptions underlying federal funding of educa- 
tional programs is that poor school districts are not able to Marshall enough 
local resources to provide the extra services to help low-achieving students; 
therefore federal or state funds are needed. We attempted Cfc> test the 
assumption that additional funds would increase performance by investigating 
the relationship between the amount and costs of resources consumed and 
consequent changes in student achievement . The finding is that there is no 
positive relationship between the total cost of the personnel and oiher 
resources used in instruction and growth in achievement. Since this finding 
is contrary co conventional wisdom, as well as the assumption underlying 
Title I and many other social programs, it deserves to be scrutinized 
careful iy . 

THE RESOURCE -COST MODEL 

Early studies of cost-effectiveness were usually based on obtaining the total 
expend! tares involved in a G program and dividing them by the number of par- 
ticipating students. This yields a per-pupii cost, but there are many reasons 
why this approach gives untrustworthy results. Report 7 discusses these 
reasons, which include: the assumption, inherent in this method of calcula- 
tion, that all students in a project receive the same services, the vastly 
different amounts of money that actually are used for instructional purposes 
even though the per-pupil expenditures are the same (due to different amounts 
that are taken 1 of f- the- top 1 for such things as administration, building use, 
capital expenditures, and staff training) , and variations in costs for similar 
services between different regions of the country. 

In an attempt to overcome the limitations o f _ the above approach, researchers 
developed a "resource-cost" model based on the ide* of applying a standard 
cost to each service actually received by students . . This "be t-cm-up approach, 
as contrasted with the top— down approach, starts with a teacher's report of 
hew much instruction each student received. The teacher indicates for each 




student the amount of reading instruction (or math instruction) received, 



and the situation or context in which the instruction was given; that is. 



whether the instruction was given in the whole classroom by the regular 
teacher, in a small group by a special teacher, in a small group by an aide, 
or' in some other instructional setting. The teacher also reports the in- 



structional materials and equipment usod. 



Standard prices were developed for each element of instruction given ur.de r 



r the 



various conditions described above'. 



These 



or ices are unirorm :or all- stucer.ts 



under similar condi 



it ions and thus ignore actual variations 



in teacher salaries 



from one region of the country to another. The basic assumption is that a 
teacher with a certain amount of education and teaching experience is doing 
as effective a job in, one job location, as in another. Likewise, it is assumed 
that similar instructional materials and equipment have the same effectiveness, 
irrespective of. their actual cost. Thus, by using this type of thinking in 
formulating a resource-cost model, a uniform, common metric was developed and 
used to cost the instruction received by each student. (This metric did not 
include administrative costs, building costs, and other overhead time/ which, 
while real, were believed not to have a direct impact on instruction.) The 
resource-cost model is described in detail in Reports 6 and 7, which also 
cite relevant 1 iterature regard ing the model and alternative methods of - 
measuring cost-effectiveness/ 

THE RELATIONSHIP BETWEEN INSTRUCTIONAL COSTS AMD STUDENT ACHIEVEMENT GROWTH 

Figure VT-1 shows the relationship between reading, program costs and student 
achievement growth* for Title I students, and Figure VT-2 shows this relation- 
ship for educationally needy students in non-CE schools. Overall, the results 
show that there is no significant positive, relationship between these two • 
variables. For some grades there seems to be a slight positive relationship 
but it is countered by other grades with slight negative relationships. In 
Report 7, detailed statistical tests are reported and the overall conclusion 

* The figures show percentage gain in student achievement during the school 

year: percentage gain equals raw gain divided by the pretest score times 100. 
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Figure VI-2. Reading Program Costs and Student Gain by Grade — 
Educationally Needy Students in Non-CZ Schools 
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is that there are. few statistically significant trends and, where they are 
significant, they tend to be negative- 'This negative correlation means that 
the most costly., the services a student receives the less the achievement gam 
made by the student J The authors of Report 7 say: 

"Our results have been nondecisive in the sense that none of our 
comparisons among groups of students rev sal meaningful differences 
in cost-effectiveness. Cn the other hand, we are net quite pre- 
pared to conclude that the level of resource utilization has no 
independent effect on outcome'. The ugh small, the raw regression 
coefficients that served as our indices of cost-effectiveness 
frequently exceeded two and three times their standard errors , 
c.nd were of can disturbingly negative. 

Taking these results at face value, one might conclude that in- 
creased utilization' of resources has a nuisance effect that tends 
to diminish achievement across most of the range of program cost 
that we observed in our sample. If this were truly the case, we 
.might be able to find a critical cost below which the returns to 
cost are increasing/ and above which they are decreasing- We 
believe such critical points should have been revealed by cur 
models that specified cost in both first and second order terms, 
but the evidence was not decisive one way or ^the other." 

It can also be argued that the reason for che slightly negative relationships 
is due to the fact that more resources are given to the more needy scud en zs . 
It is argued that the most needy students will have more difficulty in improv- 
ing their levels of achievement than less needy students and thus the negative 
relationship found is determined by the nature of the students receiving the 
more costly services rather than' the ineffectiveness of the increase in 
services. Figures 71-3 and VI -4 show the relationship between fail reading 
achievement scores and the cost of reading services received by the students. 
It will be seen that the lower-achieving students -c receive more costly 
services than higher-achieving students. While the. .relationships are net stron 
they are. at least large enough to support the idea that the negative relation- 
ship between zosz and achievement is a fu.tcci~.i cf the aehievemar. : l^vel c: 
the students being served . The authors of Report 7 say: 
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Fall Heading Vertical Scale Scores and Program 
Costs by Grade — Title I Students 
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"Much the game reasoning obtains here as in the area of health 
care*. That is, grieviously ill patients consume rnore costly 
and intensive medical care; yet the returns to such medical 
. care, as measured in success rat-as— (cures) -are probably lower 
than^those encountered with less seriously ill patients who re- 
ceive less costly or intensive treatment. In effect, then, the 
same non-equivalence among treatment groups exists in terms of 
allocating services . " 

While it is possible to offer explanations for the negative relation snip, it 
is still important to ask why a fairly strong positive relationship was net 
found in groups of students homogeneous in achievement level. The idea chat 
increasing the funding, and thus services to needy students, will lead to 
increased achievement is so pervasive and fundamental to federally-funded 
programs that these findings must be most carefully examined for faulty analysi: 
One way of checking the possibility that the results are due to a faulty 
resource-cost model is to undertake the Same analyses using total hours of 
instruction received by the student' (instead of estimates of costs of the 
resources devoted to this instruction) . The use of hours of instruction 
received is independen t . o f any cost model and in a sense is more basic than 
a cost-effectiveness analysis. Yet the results are the same as those found witl 
the resource-cost model. The authors say: 

"We are confident that our cost metric is not at fault. For ex- 
ample one might question their use in models with a single cost-, 
variable , since this assumes equal returns irrespec tive o f the 
ways in which resources are deployed. We believe we have addressed 
this question in the analyses where the data are blocked by pro- ■ 
gram configuration, and' total cost is disaggregated into ten pro- 
gram component costs. Another possibility is that the. utilization 
of resources has beneficial effects, but the benefits do not advance . 
as rapidly. as do .the costs. We have addressed that question by 
substituting program component hours for program component costs 
in some of our trials; we still obtained negative regression co- 
efficients for the individualized— instruction components and the 
special-teacher-instruction components. Therefore, the cause for 
the negative relationships is not in the cost metric alone. 11 
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The resource-cost model used has been criticized by -some researchers as faulty. 
•They say that " the model does not take into consideration local eccno'niies that 
astute school superintendents may be able to achieve, and that it also 
improperly lumps together regional variations in costs. In our view these 
criticisms are irrelevant to the study of cost-effectiveness cn -a national 
level- Nevertheless, the importance of the relationship between the costs of 
services received and gains in achievement is such that we recommend that an 
incecencent analysis of the SES cost-effectiveness data be undertaker.. It 
may be that there are .seme underlying logical flaws in the way the analysis 
was dene, although we doubt this to be the case since the methodology was 
developed at one of the most prestigious organizations in the cost-benefits 
analysis field. It is possible that an overall analysis in which ail students 
are lumped together may mask relation ships that would be found at the individual 
school level. In the /study of 55 high-poverty schools the relationship between 
amount of instruction and achievement gains was analysed. Several different 
measures of amount of instruction were used but the resulting correlations 
with achievement gain were modest and contradictory from measure to measure. 
But based on th£ present results we believe an independent analysis would 

.^..J^-^'f^^„ .^confirm the results reported ^nere or to cl.aX ( ify_ 

the methodological problems in such analyses. 
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CHAPTER VII. WHEN AND FOR HCW LONG SHOULD STUDENTS RECEIVE COMPENSATORY ■ 
EDUCATION AND WHAT HAPPENS TO ACHIEVEMENT WHEN STUDENTS NO 
LONGER RECEIVE COMPENSATORY SERVICES? 

Summary 

This chapter considers the questions of the best timing of compensatory 
services cozd the best duration of such services. It also exocrines zhe 
woolens of the frequency of termination of CE services ar.d zhe changes 
in aohievemen z growth that result 'J hen CE services are zerminczea. 
The resulzs show zhaz: 

0 ,There is no one grade in which CE is most effeczive 3 ..buz iz 

is more effective in the lower grades than in the higher grad.es. 

c There is no evidence that there is an optimum duration for CE. 

4 There is considerable turnover from year to year among 
the students receiving CE services. About 40 percent of 
the students receiving Title I in a given year will no z 
. receive it in the following year. The turnover is higher 
in other CE programs . 

4 There are three reasons for this turnover. Abcuv SO percent 
of the CE students who are discontinued are - 'promoted out' 
because their increased achievement no longer place them 
among the most needy; IS percent were promoted to grades 
that no longer had CE services > and 25 percent were in 
schools that lost CE funding in the second year ('but this 
was not ccrr7r.cn for Title T szuxienzs) . 

j The ir.ctT~ozicr.al services received by zhe, szi.d^nzs who 
" had lost CE were examined. The services of these former 
t ^zudcn^s v "»^?-/r> vi t~d zz zhe zzr^'.e services z. v iv~?d b 1 * ~ 
Re gu lor s tud'en zs . 
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o Dur-inc the year 'J hen CZ services had been discontinued^ 
the students who had been 'promoted out' continued to 
perform at their new levels end did not seem to revert 
to lover achievement levels. 

9 3y the time students reached junior high school 3 there ~cs 
no evidence of sustained or delayed effects of Title I, 

4 Former Title I students take more remedial courses in 
jun ior-hich school they, other stu den t s . 

s .4 student's socio -economic bcskgrcuKC still plays a very 
imroortcni role in achievement > even in the junior-high 
school arades. v 

INTRODUCTION 

This chanter is largely based on three technical reports, ' Report 14 considers 
when come en satory services are most effective and how long such services 
should he continued. Report 11 is concerned with the frequency at which 
elemen tarv students enter and leave the various CE programs and also with 
the changes in their achievement when their CE services have been discontinued 
Report 17 continues the study of the influence of G in later school years by 
examining the- achievement of -former elemen tary- school CE students when they 
are in. junior high school. 

WKZ^l AND FOR HOW LONG SHOULD STUDENTS RECEIVE COMPENSATORS EDUCATION SERVICES ? 

Cwir-ions differ about the tine and grade during which students profit mcst 
from compensatory education. Some have thought that compensatory services 
should be concentrated in th^ primary grades/ particularly in the fir^t ano 
second grade, based on the idea that if the students received extra attention 
^ry early they would C2tch up with students who ent^r^c ichcoi at a niihar . 
cerfcrmar.ee level. It was thought that once students had caught up, they 
would be able to maintain a- level of performance similar to that of the 
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regular students. On the other hand/ some have argued that compensatory 
services should be equally distributed throughout the elementary grades so 
that whatever students. showed poor performance, they could be assigned to 
compensatory services to assist, their performance in subsequent years. 
Similarly, there has been concern about how long compensatory services should 
be extended for students who were performing poorly. Some have argued that 
students who receive only one year of CE may well gain during that year, but 
that, if the special services are not continued they will slip back to their 
previous ceo r performance. Or. the or: her hand, it has been felt that since 
there were many more stude . ts needing CE services than there were funds 
available to support sur services, it was fairer to "graduate" students who 
had improved significa- * and let other poor performers have the benefit 
of the extra service. . we examined two questions: first, Is there any 

particular grade in which Cz, is inost effective?, and second, Is- there, an 
optimum duration for CE? 

We used two different approaches to answer these questions. First, we simply 
examined the 'graduation' 'rates from CE programs for students who had CE 
for varioils ^numbers of years and in various grades* The second approach was 
considerably more complicated^ and involved the determination of residual gains 
based on regression equations. The first approach involves starting with 
students as they entered the study and tracing the ir^CET participation for 
three years. Table VIT-1 shows the patterns of participation of all students 
who entered the study 4 in the second grade and continued through the third 
and fourth grades. The table 'should bo entered in the middle, where it shows 
that there were 5,385 second grade students of whom 2, 3S0 were judged by 
their teachers to need CS and 4,03'5 were judged not to need CE. The table 
then shows the number, for. each successive year, who were assigned to Title I, 
to other CE, to regular classes where CE was available, and to regular classes 
where CE was not available. 3y tracing the history 6 f each studerlt, one can 
determine the graduation rate for students* .who had CE for one or two years. 
Similar tables were .developed for all of the' cohorts. in the study and thus 
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all of the gvadex were included in the data. Table VI I- 2 shows the percentage 
of students who participated in Title I 'during the first year of the study and 
who graduated from Title I at the end of their first year of participation.* 
From the table it can be noted that the graduation rate for the non-needy 
students was considerably higher than that for the needy students. Second, 
the graduation rates for math and reading were very similar. A more 
important comparison for our immediate purposes is the graduation rate 
across grades. From other data we know that the first-year participation 
rates are higher in grade 3 than in grade 4. Ctnsequen tly , if we take these 
data as reflecting the emphasis of CE at these grades, we would expect 
inflated graduation rates for cohort 345 (caused by the lower extent of 
services at grade 4) and deflated rates for cohort 234 (caused by the higher 
extent of services at grade 3) from the rate expected if there were not grade 
differences in program emphasis between grades 3 and 4, When taking these 
factors into account, it appears that the graduation rates are fairly similar 
among the different grades and we cannot judge any one grade to be preferred 
to another' for the offering-of services, at least in terms of their graduation 
rates. * 

We have just examined the graduation- rates for those that participated in 
Title I for one year. Similar data were obtained for those who remained 
graduated during the third year and also for those who entered Title I 
during the second year of .the study and graduated during the third year- 
Table VII - 3 shows the results. Since the headings in the table may not be 
completely clear, the first few entries are explained below: 

51% of the needy, Title I, reading, year-i participants who graduated 
at the .beginning of year 2 stayed out in year 3, 

31% of the needy, Title I, reading, year-2 participants who had not 
participated in year 1, graduated in year 3. 

24% of the needy, Title I, reading, participants who participated in 
both year 1 and year 2, graduated in year 3, 

* Cohor-t 123 designates a group of . students that started the study in grade 1, 
and moves. successively to grade 2 and grade 3 in the following years. 
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Table VII 



Percentage of First-Year Participants Who Graduated 
Out of Their Title I Program 



Meedy First-Year Participants Non-Needy First-Year Participants 



Cohort 

Reading 

123 
234 
345 
456 



M 



310 
937 
919 
642 



24 
24 
28 
23 



2 2 2 
2 56 
2 39 
141 



32 
43 
54 
43 



Total 



3308 



25 



853 



43 



Ma th 

123 
2 34 
345 
456 



407 
467 
513 
384 



32 
23 
31 
31 



181 
202 
177 
117 



4 7 
42 
49 
38 



Total 



1771 



29 



677 



44' 



Source • Report 14, Table 2-1 
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Table VII-3 



. Percentage of Previous Title I Participants Who Were 
Graduated in the Third Year 



Cohort Needy Participants Who 

Participated 

In Year 1, but In Year 2, but 
not Year 2 not Year i 

% % 

Reading 



123 51 31 

2 34 66 34 

345 54 47 

456 - 44 . 38 

Total 55 37 
Math 

123 51 51 

234 68 • 49 

345 57 40 

456 50 50 

Total 56 44 



Source: Report 15, Table '2-2 



Non -Needy Partic ipants 
Who Participated 

3o th In Year 1 , but In Year 2 , 3o th 
Years not in Year 2 not in Year 1 Years 



24 59 45 * 33 • 

32 81 47 56 

24 92* 56 40 

19 61 51 25 

25 .77 49 42 

♦ 

20 78 66 27 
32 89 53 41 
29 .. 83 62 30 
23 68 50 .16 

26 81 59 30 
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First, it can be noted that those participating for only one year, whether 
year 1 or year 2, remained graduated from the program in year 3 at a higher 
percentage than those who were m the program for two years. This would 
apcear to mean that those who had only one year of service did better than 
those who had two years. But we do not know that these groups were equal 
in initial achievement. Figure VII-1 shows the three-year growth curves for 
those who received only one year of Title I in comparison to those who had 
two years, related to the achievement level of the participants. It is clear 
that those students who had only one year - o f- Title I and then graduated and 
remained graduated, had a higher level of initial achievement than those who 
received two years of Title I service before graduating. Thus it seems probable 
that the higher graduation rates for the one-year ; par tic ipants in Table VII- 3 
are to be understood in terms of their initial higher achievement levels. 

A second point to be observed in Table VII-3 is- that those one-year partici- 
pants who were in Title I during the first year graduated at a higher rate 
than those who entered Title I during the second year of the study. It seems' 
probable that the second year participants' did poorly during the .previous 
year, or were at such a low level that they were assigned to Title I when 
places became available, but they did not benefit as much from Title I as 
those who entered during .the first year and graduated. , Third, non-needy 
participants are more likely to graduate and r e^*i^o^ h e y most likely 

began with relatively higher achievement than the needy participants. Finally, 
to the extent discontinuation of services is determined on the basis of 
student's schcci success, the fact that more than one half of the year-1 
graduates were able to remain unassisted, can be regarded as evidence of 
• program • effectiveness .. Also the fact that the percentage of two-year 

participants who are graduated out in the third year is substantial {about a 
fourth) and similar to the percent cf fijoi-ye^r partitip^- ts wh- eradi- 
ated in the second year (see Table 711-2), indicates that the Title I program 
is able to help, some lower-achievir.g students. 
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Figure VII-1. Three-Year Growth Curves for Title I Graduates 



Source: Report 14, Figure 2-1. 
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The results just presented had the advantage of fc^ing basod on simple gradua- 
tion rates but in interpreting them we had to be' concerned about uncontrolled 
variables such as the achievement level of the students as they entered the 
Title I program. Thore were other uncontrolled variables such as socio- 
economic status, the perceived need for" the program, and cultural differences. 
To take these other factors into account, a more' sophisticated statistical 
analysis was d^ne based on residual i-ed gain scores. The achievement scores 
were adjusted _j 'correct' for a study effect, for individual differences in 
socio-economic meatus- for perceived need for CE services, and for cultural 
dif f srancss. The sc- iy-ef f ecc correction* were based on a small variation in 
scores based on the year in which the data was collected. As the study 
progressed, the test scores improved slightly frcm year to year, probably 
because the students became test-wise and the teachers became more proficient 
at administering the tes~:s. The need for the other corrections is shown in 
Table VI 1-4 , which _ .shows the way in which several student characteristics 
where related to the number of years they received CD services. (It was 
possible to include i : \:ur years of participation by using teachers' reports 
about receipt of CZ d-iring the year before the' study began.) 

Table VII -4 

Characteristics of Students by Years of Participation in CZ 



Background Characteristics 


Years 


of Participation 


in a CZ 


Program 


0 


1 


2 


3 


4" 








Reading 






Scoioeccnoauc Status 

Judged S :*i fc.r C2 

oisiiiar.icy to Jiajcrity Culture 


248 

. Z. 23 .. 
1.66 


204 

J, * C vJ 

1.45 


177 
1.37 
1.29 


163 
2.31 , 
1.14 


152 . 
2.50 
1.11 




21,883 


7,098 


5,197 


3 ,661 


1,554 








Hath 






Socioeconomic Status 

Judged Need for CZ 

Similarity to Majority Culture 


242 
0.S1' 
1.64 


190 
1.23 
1.36 .. 


155 
1.89 
1.15, 


15 3 
2.25 
0.99 


. 154 
2.56 
0.93 




26,300 


6,380 - 


3,575 


2,212 


796 ■ 



ERIC Source: Recort 14, Tahle 1-7 PP: 



It: will be. seen that, aa the number of years that different students were in 
CE programs increased, the students' socio-economic status decreased, judged 
need for CH increased, and similarity to the majority culture decreased. These 
trends are very consistent and need to be accounted for in determining success 
rates by grade and length of CE receipt. Accordingly each student f s scores 
had correction factors applied to make the data more comparable. The five 
characteristics (socioeconomic status, judged need for CE, cultural similarity, 
age at entry into the study and non-English spoken in the home) were used as 
predictor' variables separately for adjusted reading and math achievement: scores 
in a. regression analysis at each of the twelve, data points defined by grade- 
testing occasions- The achievement predicted could then be subtracted from the 
new scores, so that the effects of background on achievement would not obscure 
our findings. Table VII-5 shows the average residual vertical scale scores 
resulting from these adjustments, as a function of years of participation in 
CS programs for each grade and testing occasion. First, it should be noted 
that in c both reading and math, all the residual means are positive for the 
students who did not receive any CE. A positive residual implies that the 
group's actual performance is better than expected on the basis of the regres- 
sion equation." Also it can be seen that almost all of the groups with at 
least one year of CE have negative residuals. If wer consider the overall 
average residuals (the bottom line of TabJe VII-5) as indexes of the need for 
CS bv each group, those students who received only one year of CS needed it 
least, and the others are about equal in their need.'" Furthermore, the earlier 
the need for CE was identified, the more students were able to benefit from CE 
services. Four years of reading CS appears to be beneficial if started in 
grade 1, however by grade 5, "four years is much less effective. In math, the 
situation is similar, expect that che beneficial effects cf four ysars cf CE 
extend beyond the first grade. Based on these data, we conclude that there is. 
no optinal amount 'of CE; however early treatment appears to be effective. 

Figure VII -2 shows plots of the adjusted residualized scores for each group 
having CS for various periods of time against the year of the study. If will 
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Table VI I -5 



Moan Residual Achievement Scores at Each Grade and Tuatijig Occasion 
Sor Groupa Based on Years of Participa ticn in CS 



Reading Hath 



Grade Testing Years of Heading CS Years o£ Math CE 







0 


1 


2 


3 


4 


0 


1 


2 


3 


4 


1 


F ' 


3 . 2 


-2 .5 


-6.3 


-4.5 


4 . 5 


1.9 


-3,6 


-5.6 


-3,0 


3,4 


1 


S 


5.9 


-3.6 


-11.4 


-a, 7 


2,2 


2,4 


-5,6 


-7,9 


-2,9 


10,1 


2 


p 


6.6 


-3.8 


-11.8 


-9.1 


-3.7 


3.3 


-6.5 


-8.0 


-3.7 


-2.3 


2 


s 


7.0 


-4.5 


-11.6 


-9.6 


-4.7 


3.3 


-6.5 


-9.3 


-4.9 


3.6 


3 


p 


7.3 


-4.5 


-11.6 


-9.8 


-9.8 


3.2 


-6.2 


-9.1 


-6.0 


4.4 


3 


s 


7.4 


-5.8 


-12.0 


-9.1 


-6.7 


4.0 


-9.3 


-9.6 


-6.3 


5.7 


4 


F 


7 J 


-5.5 


-11.1 


-10.1 


-11.3 


3.9 


-8.0 


-9.3 


-7.1 


-0.9 


4 


s 


7.3 


-5.5 


-10.9 


-10.4 


-11.5 


4.6 


-8.4 


-11.1 


-10.4 


-5.1 


5 


F ' 


6.7 


-7.0 


-9.3 


-12.0 


-16.3 


3.8 


-8.5 


-9.6 


-7.8 


-6.3 


5 


S 


7.3 


-3.7 


-10.3 


-10.5 


-17.4 


4.1 


10.1 


-11.0 


-10.3 


-3.9 


6 


F 


7.4 


-10.4 


-11.9 


-13.3 


-20.4 


.. 4.4 


-12.2 


-14.0 


-2.7 


-14.1 


6 


S 


7.3 


-11.2 


-11.8 


-12.1 


-17.7 


4.4 


-13.9 


-12.2 


-1.4 


-9.2 


Average 


7.0 


-6.0 


-11.0 


-10.0 


-10.3 


3.8 


-a. 2 


-9.8 


.-6.4 


-0.9 


Soujtcs : 


Report: 


14, 


Table 
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ho noun Liu I:, tlio vocfular lituduiitii havo [. o. 1. Uivn r^j «j Li.Uui.1 u; r «i.id Li."-:£ j ro :i . m«jw«jvo »; , 
the other group:.? on utudcmfc.a havu nncjativa .ycocaL; which tond to bi* rather 
close* together. At: first, it aaomiJ far ruading that ono yoar may bo moat 
effective hut fchon four years approaches it in the final taut period. For 
math one, two, and threes yecirs of CE seem to be similarly effectives, with four 
years being most affective. In looking over all the data we cannot see a 
consistent trend that indicates an overall optimal duration of CE participation. 

Similar curves were drawn for the grade at which there was participation in CE , 
as shown in Figure VII-3-. -The dotted portion of the lines shows the year of 
participation in CE. It will be observed that .as the year of participation 
in CE increases from prior to grade one, to grade one, to grade two, etc. 
through grade six, there is a steady decrease in the residualized scale scores. 
This evidence seems to indicate clearly that earlier participation serves an 
important preventive function. Other less obvious implication^ of Figure VII-3 
are : 

The decreases in means with increasing grade of participation are a 
bit larger for reading than for math, indicating that math CE has 
a stronger effect on math achievement than reading CE has on reading 
achievement. 



The decreases with increasing grade of participation are observable 
at the initial testing, the testing just before participation, the 
testing just after participation,, and at the last testing. 

The dotted line segments are usually preceded by decreases in 
achievement and followed by increases in achievement at the early 
grades, but by further- decreases at the later grades. The 
implication could be that CE has some sustaining effects at the 
early grades, where the participants are less seriously in need 
and where CE has more immediate impact. 

With all these joasidera tions in mind, and with the additional consideration 
of supports cive findings irom Chapter V, we conclude that CE in the lower 
grades is more effective than in the higher grades. 
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Figure VII -2 

Helaiive Achievement and Years of Participation in CK Programs 
Report I 'I, Figure 3-2 
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Figure VI I - 3 

Relative Achievement: of Students Participating 
; in CE Programs at Each Elementary Grace 
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WHAT HAPPENS TO THE ACHIEVEMENT OF STUDENTS WHEN THEY NO LONGER RECEIVE CE? 

The discontinuation of CE services became an important educational issue when 
it was. reported (GAO, 1975) that districts and schools differently interpreted 
the Title I requirement to serve the most educationally deprived students. 
Under one interpretation, as long as the student is among the low achieving 
when entering the program, that student is to be retained until reaching an 
age-appropriate achievement level. Under another interpretation, a student 
has to remain among the most educationally deprived to be retained in the 
program; otherwise, the student is replaced by a student who is lower 
achieving. Under a third interpretation a student is retained in the program 
even after reaching an age-appropriate level, in the belief that the extension 
of services is necessary to maintain achievement growth. Based on these GAO 
findings and oh recommendations from states, districts, and the USOE, bearing 
both on student needs for stable programs and institutional needs for 
educationally sound guidelines, Congress clarified the law (Education Amend- 
ments of 1973, Public Law 95-561) . The amended law emphasizes that Title I 
funds must be used to meet the needs of students in greatest educational need, 
but it provides an exemption (among several) for students who were determined 
to be in greatest need in a previous year but no longer are. In effect, the 
amendment allows schools and districts to maintain Title I services for 
students who qualified in the previous year, so that students are not caught 
in a "revolving door" of alternating receipt and disqualification. 

But the GAO findings were based on less than representative data and the 
recommendations from other sources tended to be based on impressions and 
anecdotes. Ir. the Sustaining Effects' Study it was possible to study zhe 
problem in detail anc determine whether cr not it was serious. three questions 
were studied: 

1. What is the incidence of the discontinuation of CE services? 

2. What educational services do students receive after their CE 



services are discontinued? 




3. What happens to the achievement levels of students after their 
CE services are discontinued? 

For the major study, data were available for the 1976-77 and the 1977-78 school 
years. Data from the 1977-73 school year were more reliable because we had 
positive records of each student's status in the previous school year. For 
the 1976-77 school year the students 1 statuses were reported as teachers 
remembered them and were thus subject to some error. The two data bases were 
analyzed separately and tend to support each other. Therefore, only the 
results from the 1977-78 school year will be reported here and are given in 
detail in Report 11. 

What is the I ncidence of the Discontinuation of CE Services? 

Three reasons for the dicontinuation of CE services were available for study: 
first, services were discontinued because the student had reached an achieve- 
ment level that no longer qualified the scudent for CE services; second, ser- 
vices were discontinued because a CE student was promoted to a grade which did 
not have CE services; and third, the student was in a school during the second 
year -that lost funding in the second year even though it had funding in the 
previous year. About 60 percent o£ the students no longer receiving CE ser- 
vices had them discontinued because they were na_. longer qualified due to high 
achievement; 15 percent were no longer selected for CE because they were pro- 
moted to grades in which there was no CE program, and 25 percent were discon- 
tinued from CE because their schools lost CE funding (although this was not 
common for Title I students) . 

There are two ways of looking at the data. Cn the one hand we can ask what 
percentage of all the students in the" school have their services discontinued; 
cn the other hand we can be concerned about the percentage of stucneu-j in a 
particular CE program who have ser/ices stopped. Table VI I -6 shows the data 
both ways- When viewed from the perspective of all the students in the school, 
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Table VII--6- 

Percentage of Students Whose CZ Was Discontinued, by Reason 
for Discontinuation, CE Funding .Source , and Subject Matter 



4 of Title I 

Title I % of All Students Students in Year 1 

Reading Hath Reading Hath 

Former Title I students no longer 

qualified 6 4 34 32 

Former Title I students but school 

lost funding 0 1 0 7 

Former Title I students but pro- 
noted to non-Title I grade 10 5 4 

Title I students in both Year'l 

and Year 2 ' 12 7 61 57 

New Title I students in Year 2 10 8 / 

Not Title I students in either 

Year 1 or Year 2 72 80 

* of Other Federal 

Other Federal CZ - % of All Students CZ Students in Year 



Former Other Federal CE students 

no longer qualified 1 1 21 22 

Former Other Federal CZ Students 

but school lo3t funding 2 : 1* _ . 4-1 33 

Former Other Federal CZ students 

but prompted to grade without 1 1 20' 25 

Other Federal funds 

Other Federal CZ students in both 

" Year 1 and Year 2 1 1 19-21 

New Other Federal CZ students in Year 2 2 1 

Not Other Federal CZ students in either 

Year 1 or Year i 9 if- . ~ 96 



Source: P.ecort 11/ Table 1-1 
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the problem does not seem particularly large. Depending on the CE program 
involved and the subject matter, the percentages vary, but about 5 percent 
of all the students have CE programs discontinued. The more important 
figures are the proportion of CE students who have CE services discontinued. 
For Title I about 40 percent of the students receiving Title I services in one 
year will not receive Title I services the next year. For both ocher federal 
programs and state/local programs, the turnover is considerably larger than 
in the Title I program. The students losing Title I services are mostly 
those who no longer qualify because their academic achievements place them 
above other more needy students. For the other federal and the state/local 
programs there is a much stronger tendency for the schools to lose funding 
or to have the students promoted 'to a grade without that category of funding. 

(Table VII-6 Cont'd) 



% of State/Local 

State and Local CE % of All Students CE Students in Year, 1 

Former State/Local CE students .2 1 21 13 

no longer qualified 

Former State/Local CE students 4 2 36 32 

but school lost funding 

Former State/Local CE students 11 7 16 

but promoted to class without 
State/Local funds 

" State/Local ■ CE students in both 4 2 35 34 

Year 1 and Year 2 

Mew State/Lccal CE students in 7 6 

Year 2 

Mot State/Local CE students in S3 S6 

Year 1 or Year 2. • 
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Table VTI-6 clearly demonstrates that there is considerable turnover among CE 
students. 3ut is there evidence that there really is a difference in achieve- 
ment levels between those whose CE is discontinued and those who continue in 
the CE program? Table. VII-7 shows the average Comprehensive Tests of 3asic 
Skills achievement percentiles for the different groups in terms of their 
statuses in Year 2 , The scores are for the spring of the first year because 
that cericd represents the time when achievement' information would be available 
for decisions about assignment to the ensuing .year 1 s classes. The table shews 
that the regular students are slightly above the mean in achievement while 
all categories of previous and present CE students are considerably below the 
mean. Students who have had their CE services discontinued for one reason or 
another fall considerably below the regular students but considerably above 
those who continue in the CE programs. Those continuing 'in the program have 
achievement means in the 25th percentile range, while those whose services 
have been discontinued tend to be in the 35th percentile range. Thus it is 
apparent that students whose CE is discontinued are those who are performing 
relatively well and that those who are retained in the programs are still 
performing poorly. • These- figures indicate that CE administrators are behaving 
appropriately in deciding which students to, retain in the' program and which 
ones to ' promote out. ' At the same time we should no t • forge t that those 
who were 'promoted out' were not doing^ as well as the regular students. 

Clearly for CE students there is a large turnover, with many students receiving 
CE services in one year and then having them discontinued the next year/' Hew 
serious is this? Cne way of looking at it is to say that it is not serious at 
all. If in the second year the student is clearly not as needy as other 
students, then the other students should receive the services and, with 
limited funds, the less educa ticp.aliy needy student should be erected from the 
program. But, if Ln the process the student whose services were discontinued 
drops back and again joins the most needy ranks, then the programs' goals are 
undermined and we have a revolving -door process. But this is only a potential 



problem; what really happens to students who .have seen promoted cart b^uaub-e- 
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Table VI I -7 . 

Average CT3S Percentile Scores Over All Grades by Transition Category 
(Percentile Scores for Spring of Year 1, Transition Categories for Year 2) 

Transition Category 



Regular students 

Discontinued frcra CE in Year 2: 
Due to high achievement 
Due to promotion to, non-CE grade 
Because school lost funding 

CE Students : 

Continuing in program ' from Year 1 
Started CE in Year 2 



Source:, Report 11, Table 1-9 
Educational Services After Termination of CE 

The regulations for Title 1/ by far the largest of the CE program?;, specify 
that CE services are to supplement rather than supplant regular instruction. 
Because the number of hours in the school day is usually r.oc increased for CE - 
students/ the CE program usually consists of different instruction which is of 
greater intensity or higher quality than that for regular . students, as we 
noted in Chapter III. Or the CE program may emphasize instruction in reading 
and math at the expense of other subjects being taught to the regular students. 
When a student ' s "CE services are discontinued, we would expect that the hours 
and costs of reading and math instruction would revert to approximately that 
of regular students. Is this actually the case? 
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Mean CT3S Percentiles 
Reading ' Math 

55 51 

34 38 
30 35 
34 37 



22 26 
32 33 
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Table VTI-3 shows the hours and costs of reading and*. math instruction average'- 
over all grades by student category. The table shows that the number of hours 
and costs of instruction for continuing CE students are considerably higher 
than they are for regular students. The corresponding figures for students 
whose CE has been terminated are quite close to those for the regular students. 
There are wide variations in the services offered from grade to grade in reading, 
however, so the average figures do not give the whole picture. Figure VII-4 
shows the cross-sectional costs of instruction by grade. Again, we see for 
reading the marked decrease in the cost of reading instruction as grade 
increases, and we also. see the much higher costs of the reading services 
offered to CE students. There seems to be a slight tendency for discontinued 
students to receive more costly services than regular students, but they are 
clearly differentiated from' the continuing CE students. A similar figure for 
math would show the same picture as that for reading, except that math 
instruction costs are relatively constant across grades. From this material 

"Table VII-3 
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* Standard resource dollars 

Source : ^ecort.,11, T a Lla 2 -4- 
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Average Hours and Cost 
Year by Stud 


s of Instruct! 
ent Transition 


on During 
Category 


the Second 




Transition Category 


Readinqr 




Math 






Hours . 


Cost* 


Hours 


Cost* 


Regular Students 


2 38 


245 


175 


135 


Discontinued from CE in 
Year 2: 










Due to high achievement 


242 


231 


134 


■ 172 


Due to proration to non-CZ 
grade 

Because school lost funding 


226 
245 


231 
295 


156 
179 


150 
153 


Continuing CE students . . 


' 265 


420 


208 


2 73 
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it is clear that: when students are terminated from CE they really do stop 
receiving the 'services they would have been receiving if their CE status 
had not changed. When one looks at. the nature of this change, it becorr.es 
acoarent that the discontinued students are getting their instruction from 
regular .teachers rather than from special teachers in small groups. This may 
not necessarily be bad.' We have already seen that regular teachers tend to 
be associated with superior instructional results. What in face happens to 
the discontinued students? Co their achievement levels drop. as a result c: 
the lack of rrore costly and intensive services? 

Achievement After Termin a tion of CE 

We new know that students are terminated from CE programs for a number of 
reasons, and that high on the list is termination because they are achieveing 
at a level that is relatively high. We also know that if a CE student is 
terminated, then' the new instructional program takes on the characteristics 
of the regular program. The question now is whether the terminated CE stu- 
dents retain their relatively high levels of achievement or whether they 
revert to previous lower levels. There are two ways of looking at this ques- 
tion. One way is to determine the relative achievement status of the students 
at the end of the next instructional year to see if they still are achieving 
at relatively high levels- The other way of addressing the question is to 
look at rates of growth during the subsequent school year to see if they con- 
tinue growing at the same rate as when they were receiving CE . Both approaches 
will be examined. Table VII-9 gives the percentile achievement levels for stu- 
dents in the spring of the second year. This table is for Title I students. 
Similar data are. 'available for other federal programs and for state/local pro- 
grams, and the interested reader can refer to 3ES Report 11 where it will be 
seen that the results are similar to those for Title I. The table shews, for 
both reading and math, that the regular students achieve in the spring of the 
second year at levels considerably above the average. Those Title Z students 
whose CE program continued during the second year are still performing at 
cuite low levels. However, those students who had been Title I students, and 
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Table VII-9 

Average Reading and Hath Percentiles for Spring of 
the Year After CE Students Were Discontinued 



C ategory 



Grade 



Regular students 

Continuing Title I students 

Students Discontinued frcta Title I; 

Due to high achievement 

Due to promotion to class 
without Title I 

Because school lost funding 



2 

Reading 
61 
24 

36 
41 



63 
26 

42 
34 



65 
17 

37 
30 



60 
20 

28 
32 



53 
17 

30 
36 



Math 



Regular students 
Continuing Title I students 



Students Discontinued from Title I: 

Due to high achievement 

Due to promotion to class 
without Title I- 

Because school lost funding 



59 
33 

41 

48 
39 



59 
23 

41 

48 
45 



56 

25 

37 

30 
30 



59 
22 

33 

22 

38 



58 
31 

35 

24 

J 6 



1 



Source: Recort II, Table 3-3 



whose services were discontinued du- . to their higher achievement continued to 
perform at levels which, while not equal to the 'regular' students, are much 
higher than for those students who continued in Title I. It certainly appears 
that those students who had their services discontinued did not drop back to. 
the level they were at when they entered Title I'. 

The second. way of examining the cuesticn of whether the discontinued students 
have continued to grew at races similar to races while they were CE students 
is co examine growth curves. The general idea is to determine che race eff 
growth of the student during the year in which the student received CE and 
then to compare that growth rate with the growth race in the next year when 
the student did nc • "ve CS . This is a somewhat complex and inexact 

comparison due to several factors. First, we know that the measured rate of 
growth decreases for each successively higher' grade and thus the second year's 
growth should be somewhat 'less than the first year's rate. A way to gee 
around this difficulty is to form comparison groups and see if the growth of 
those whose CS services were disconcinued is similar to the growth of those 
whose services were continued (or a similar comparison can be made with 
regular students). The problems with this method are that students of 
different achievement levels grow at different races, and regression-to-che- »■ 
mean effaces are different, depending on achievement level. While bearing 
these problems in mind, we attempted to compare growch rates. The general 
method was to determine the growth that took place in the first year and frcm 
that growth to predict the growth that should take place in the second year. 
Then the actual growth in the second year was compared with the predicced 
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growth in the secenc'year 
the actual crewth is called the difference score. If the student grew -ore 
than was credicted then there is a positive difference score, ana ic tne stu- 
dent grew less than predicted there is a negative difference score. 

Table VII-iQ shows the residualired gain scores during the second year rcr 
students who had been Title I students in Year 1 but where services were 
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discontinued in Year 2. Their gains are compared to th 


eir previous 


vea 


r gains 


and to the gains for regular students, and for students 


who "received 


Title. I m 


services in both Year 1 and Year 2^ (Similar results were obtained 


for 


the ' ■'! 


other funding categories and can be examined in Report 


11 . ) Discontinued 


Title I students had lower gain scores than regular students in comparison to 


the growth rates for the students who received Title I 


services in both 


Year 1 


and Year 2.. The discontinued students have positive growth rates. 


Whi 


le this 


positive growth is encouraging and consistent with the 


general findi 


ng 


that 


Title I has a positive effect, the conclusions need to 


be temce red bv r 


£3 ^ rr* — 


bering that these students come from the lower part of 


the achievenen t 


discri- 


bution and will exhibit higher regression effects than 


the other two 


gr 


oups . 


Table VII-10 








Average Residual Gain Scores from Year 2 for Students 
Discontinued from CS Due to High Achievement. 








Grade 






2 3 


4 5 




6 


Reading 








Regular students -22 ~S 


-14 -12 




0 


Continuing. Title I students 6 4 


13 3 




12 


Students whoso Title I vaa -6 —2 
discontinued 


o -a 




.1 


Hath 








Regular students -12 -17 


-1-i -16 




-9 


Continuing Title I students 9 9 


9 4 




6 


Students whose Title I was 27 11 
discontinued 


10 -4 




-7 



Source:- Report 11/ Table 3-6 
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In math, the previous Title I students seem to surpass their expected rear 2 
growth when they are in graces 2, 3, and 4, but not to exceed expec ta ticns in 
grades 5 and 6. (In interpreting these figures we must remember that they are 
expressed in vertical scale scores and not percentiles. Generally, a gain of 
about six vertical scale scores is required to be significant at the .05 
level.) 

The conclusion to be drawn is that those students who have had their Title I 
services discontinued ccntinue to grew 'in the next year at about the rate that 
would be expected if they had continued to receive Title I services. The data 
■ succorting this conclusion are not as clear as would be desirable because they 
are contaminated by the fact that comparison groups come frcm different levels 
in the achievement distribution and thus grow at different rates, and also by 
.the problem of differential regression ^ rates . However, when we .consider the 
results based on growth rates and the results based on the percentile scores 
achieved in the spring of the second- year, we feel safe in concluding that the 
discontinuation of CZ services for the higher of the ic w-achieving CZ students 
dees not result in an impairment of their achievement growth in the subsequent 
schcci year. 3ut the firmness of this conclusion is somewhat tempered by the 
results from the three-year longitudinal data. Referring back to Figures V-7 
and V-3 we can examine the continuing performance of Title I students who 
received Title I daring only the first year of the study. It will be seen for 
reading that these students tend to retain their relatively high performance 
after they are no longer receiving Title I. However, for math the picture is 
. * not as encouraging, with the former Title I students tending to lose their 

percentile achievement level, but still remaining above other Title I students. 
With these students we cc not know how many lost their Title I services because 
they- ware 'promoted cut' but we do knew that "'in rath, mere frequently than in 
reading, students lose their services for funding and administrative reasons. • 
Considering both the results of the longitudinal study and the results zi 
Report 11, we believe the 'promoting cut 1 of high-achieving Title I students 
does not do them any great disservice. 

ERLC 
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THE EFFECTS OF: ELEMENTARY -SCHOOL COMPENSATORY EDUCATION ON STUDENTS WHEN THEY 
ARE IN HIGH SCHOOL 

Originally the Sustaining Effects Study was not designed to follow students 
beyond the sixth grade, but as the study matured it was realized that it 
would be desirable to follow some students into high school. By the late 
1970*3 education policy makers believed the federally supported -jcmp ensatory 
education programs in the elementary grades were well in place in offering , 
assistance to disadvantaged students in these grades. However, it was not 
clear that the elementary grades were the best grades in which to give remedial 
services. It was also apparent that little federal money was going to 
secondary schools to assist students at that level who we're having difficulty 
mastering basic subjects. Larson and Dittmann (19) studied- this question 
and suggested that limiting compensatory intervention' to the early grades 
would make sense only if the. skills acquired in those grades were the only ' , 
skills society believed important -for disadvantaged students. They also 
suggested that overcoming deficits at early ages may not be, as critical as 
overcoming- them at- later ages. They also argued that even if early compensa- 
tory efforts were effective, their impact may dissipate without maintenance 
efforts. In view of these ' concerns we ..were asked to try to follow some of 
our students into junior : high 'school to determine the influence elementary 
• school CE might have orrsecondary school achievement. We collected data at 
the junior high school level to try to answer the following questions: 

1. Are the achievement benefits of CE received in the elementary 
grades, sustained into the junior high level? 

"a. What is the long-term effect of CE participation- on 
achievement? 

b. Does intensity of instructional .services have a delayed 
effect on achievement? 

2. What effect do secondary schcol courses have on the achieve- 
ment of former CS participants? 

3. .How do student background characteristics relate to achievement 
in secondary school? 

2-1.7 



Since we are mainly concerned wich the effect of compensatory "education we 
limited our selection of students to those from high-cover ty elementary schools. 
We selected 51 schools with more than 20 percent of their students below the 
• poverty line. These schools were fairly well distributed throughout the 
country. Since we had not planned to follow these students into secondary 
school we had no records to tell us where they had gone on leaving elementary 
school. We "asked the local coordinator in these elementary schools to search 
the records of the secondary schools where their pupils normally went on 
graduation and to try to locate the students studied et the elementary school. 
The exact way we located the students is described in Report 17, but generally, 
for these schools, we were able to locate, and test about one-third of the 
students who had been in the study and graduated from the elementary grades. 
After excluding from the sample all the students who had missing data, there 
were roughly one thousand students in each of three cohorts; those who made up 
cohort 4, those who had been in the study during elementary grades % 4, 5, and 5; 
cohort 5, these who had been in the study during elementarv grades 5 ..and 6; and 
cohort 6, those who had been in the study during grade 5.. In the spring of the 
school year we administered to those students the appropriate scales from the 
Comprehensive Tests of 3asic Skills. Thus, the t^t was administered to 
cohort 6 in their" 9th grade, to cohort 5 in their at A. grace, and, to cohort 4 
in the 7th grade. , ^ 

In reviewing the characteristics of the students who remained in the sample 
it was clear that tine sample was not representative of ail CE students due to 
differential attrition. Retort 17 discusses this attrition and .it can be 
summarised by saying that ncn-Hispanic speaking Asian students, students wr.o 
s ? eak only English, students who do not participate in free meals programs, 
and students with rare educated parents, are more likely to remain i: 



scite of the 



seme what biased 



are more likely to remain in tne, 
nature of the sample it still con- 



tained a large number of CE students from poverty backgrounds. In cur analysis 
we attempted to account for these systematic biases . 
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In the analyses we had available the following variables: the background of 
the students, whether or not the student participated in CE, the intensity of 
the CE instruction, the hours of secondary school instruction in .reading and 
math, the mix of secondary school instruction between remedial courses and 
regular courses, and the achievement measures obtained during both the 
elementary school years and one secondary school year . 



First we investigated the extent to which these students continued to make 
remedial courses 'in junior high school. It was found that, in- terns of the 



to students who' had not had Title I, did not receive more reading instruction 
at the junior high school level, but they did receive slightly more math 
instuction. Each additional year iri junior high provides less reading 
instruction, but each additional year provides roughly the same number of 
hours of math instruction. However, when we consider the course mix we find 
that the former Title I students take considerably more remedial coursawcrk 
in junior high school than do students who had not had Title I in elementary 
school. In other words* the former Title I students are still finding it 
'necessary to take remedial .'work while regular students do not heed these more 
basic and easier courses . 

In following achievement growth it is possible to form eight different 'groups 
of students in terms of whether or' not their elementary teachers , judged they 
needed CE, whether or not they had CE in the elementary grades, and whether o 
not they took remedial courses -in junior high school* In Report 17 there are 
graphs showing the achievement growth curves for each cohort and for each of 
the four different academic subjects. Since these many curves are quite 
similar we have only reproduced one of them here. The one shown in Figure VI 
is for cohort 4 cn the vocabulary scale. 



total reading and math' courses taken, the former Title I 



students , relative 
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The figure; provides soma interesting information about the nature of the sarr.pl 
of students from high-poverty elementary schools. We can see that these 
schools have a group of students that starts above the national norm and stays 
above it into junior high school. These students are frequently overlooked 
in public discussions of poverty schools. They are good students and remain 
that way. The four groups initially judged by their teachers no need CZ, on 
the. other hand, start off considerably below the national norm and never catch 
up to it. Inspection of the levels and slopes of the lines indicate that the 
Title I participants start: at a very low level of achievement and end up in th 
same low position, although they do grow at the same rate as the other student 
The curves shown are really quite remarkable in their regularity, with the 
Title I students on the bottom, the needy but not Title I groups next:, and the 
regular students above the national norm. Also within each group those taking 
remedial courses are below -those not taking such courses. Other curves could 
have been drawn for the students who were judged by their teachers not to need 
C£ and who either did. or did not have Title I or did or did not have remedial 
high school courses. But these curves would have only confused the figure and 
they would simply confirm what is already shown. These findings speak well 
for the operation of the schools in terms of their selection of students for 
CE and for the. proper assignment of remedial instruction. Also it should 
again be noted that while the Title I students start at the bottom and remain 
there, they nevertheless grow at about the same rate as the other groups. 

From Figure VII-5 and the similar graphs in Report 17 it is possible to judge 
the effectiveness of remedial coursework. One can compare the achievement 
scores of similar students who took remedial coursework with those who did not 
It will be seen that the slope of the curves during the j u:u:r high schcci yea 
for those who took remedial coursework, when compared with those who did not 
take such work, is about the same. There is no evidence that remedial course- 
work was effective in improving the performance of those who tcok it when 
compared to the performance of those who did not take it. Thus, we cannot 
recommend that the way to improve the performance of disadvantaged students 
at the secondary level is to increase the amount of remedial coursework, at 
least as it is now offered, ^ M 
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An Anal ysis of Scho ol Sffggts and Student Background cn Achievement . It will 
'be remembered chat a: the beginning of this section we presented several policy 
Questions and also point-ad out the different variables on which information had 
been collected- 3y analyzing these variables through a regression model we 
were able to answer the policy questions. In Report 17 there are a large 
number of different analyses made in tems of the three different cohorts, 
the four test scales, and different ways of defining achievement outcomes. 
To simplify the presentation only one of the models will be shown, here. 
Figure VTI-S shows a roc el for cohort A with final "th grade achievement m 
vocabulary as the criterion of successful instruction . 

Several things are immediately apparent. Student background is the only 
variable positively related to 7th grade vocabulary achievement. (The 
numbers in Figure VI 1-6 are the standardised regression coefficients). The 
other coefficients are all negative and some of them siynif icantly negative. 
This is what we would expect because we. knew the.;: for the whole school popu- 
lations that level of achievement is negatively related to both receipt of 
Title I and intensity of instruction/ as well as to a high proportion of reme- 
dial to regular courses. It should also be noted that the student backg jur.d 
variable makes a larger contribution than any of the c~:ier variables. This 
points cut that the high level of achievement attained by students from 
advantaged backgrounds persists ever, into high school and is not overcome by 
previous schooling variables. While we should expect this outcome s imply "or. 
level of achievement, the same results were obtained for achievement gain, and 
for relative gain, where differential growth rat?s were taken into account., 
Thus, similar results were obtained for all these different cri n: of . 
achievement. 

The initial pciioy questions and their answers are: 

1. Are the achievement effects zf TiiZ* 1 in -he zler.er-ar-j 
arcdas sustained into zha *\jzic?-r.ich level? 

250 

ERIC 



Hours of 
Instruction 





Instruc tional 
Mix 



In tens icy of 
Instruction 



-.13 




-.01 



Background 

Grade 4 



Grade 5 



Grade 6 



Vocabulary Achie vemen t 



Grade 7 



Figure VI] 



Structural Med el for Assessing Zffac: 



In ten si-ty o f ■ Ins true ti or. / Remedial/ Regular Mix, Hours of Introduction. , 
and S tudent Background on' Vocabulary Achieverr.en t . 



Report 17/ Figure 4-2 and Table 4-3 
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The heart of this question is "long-term ef facts" . Wo can define lun j-^r:n 
effects a 53 the sum of all gains attributable to Title I. Accordingly, four- 
year gains are the accumulation of immediate and delayed effects of Title I 
and other school experiences . Four-year effects should be the most apparent 
because tine immediate and delayed effects are accumulated, and because in these 
analyses we measure the longest term of .exposure to educational services. 
However, when the definition of "long-term" emphasizes the sustained effects 
of Title I, two perspectives are possible. We can view the sustained ?ffaczs 
as j us t delayed effects, and examine them in the delayed-gains analyses. In 
this case, the immediate effects of Title I are excluded, leaving only gains 
sustained after participation in Title I has been suspended. Alternatively, 
the long-term effects of Title I can be seen as the effect noticeable on the 
final outcome measured at the end of the study. 3oth of these possibilities 
were dealt with in our analyses. Additionally, we were able to address the 
different' conceptions in ter^s of relative gains. Thus, our five criteria 
cover a wide range of interpretations of "long-term" effects. Our analyses 
do not indicate that Title I or instructional services at the elementary level 
have long-term effects, either immediate or delayed. 

We also have three cohorts that allowed us to compare effects between them 
with respect to grade in which services may be more effective. Finally, we 
have four subtests that we used to 'pinpoint particularly effective facets 
o f • Title I. Unfortunately, differences between cohorts and between subtests 
were not found to be systematic , so we cannot draw any generalized conclusions 
regarding grades in which services are particularly effective or subjects 
that are particularly affected. 

We described intensity of instructional services as a natural function cf 
schooling and schools' assistance to lew achievers . We also described it as 
a possible alternative measure of Tide I participation, because intensifi- 
cation of instruction is tine main force of Title I. The results indicated 
that the two were closely related, but that each should be- allowed to play its 
role in our models. Oero 



affect do secondary ^aokool eauvs*io have c>\ <::c*\ievc- 
of feme? Title I participants? 

The focus is on former ' Title I participants, but discerning which students 
truly are former participants is problematic. Although we have indicators 
of participation in grades four through six, we do not have them for earlier 
grades. The mix of courses taken in the secondary years was combined with 
participation in each of the elementary years to create interaction terms 
Jor testing- These interactions generally made very small contributions to 
the pre/Ration of the achievement criteria/ indicating that the Larson and 
Dittman (19) suggestion- of the possible value of increased remedial services 
at the secondary .school level was not substantiated. However, the larger 
question to be answered is whether high concentrations of remedial classes 
help the achievement of anyone, especially those once participating in Title I 
We found no evidence that secondary courses have effects, but we could discern 
evidence that lower achievers (Title I participants) are more likely to take 
remedial courses. 

3. Bow does student background relate to achievement level 
in secondary school? 

This question addresses the effects of background, and is the most straight- 
forward question to answer. We looked for effects of background on each of 
the criteria.' Mot only were we Interested in the effect of high or low 
status on different facets of achievement, but the -degree that this out-of- 
school factor dominates school factors. We found that background still plays 
a very important role in achievement, even as students move through the 
junior -high grades. This finding indicates that poor students aire not 
particularly more receptive to instruction in later grades* nor in specific 
subjects. 
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CHAPTSU VIII. WHAT h'APrSNS TO STUDlilMT ACHIKVUMKNT GV2;'. 
THH SUMMED, AND IS SUMMER SCHCOL EFFECTIVE? 



3urmar\j 

This chapter examines two questions, The first concer>i3 

of achievement loss or gain over the summer. The second 

zhe effectiveness of summer school. Trie results are: 

19 There are quite large reading gains' over the 
suflwer . There ere bo vh nczh gains and losses 
o ver zh e summer , Far t i oil I ccr I y i n zh e h ig *: e r 
grades there may be losses. 

» In comparing CS students with regular students j 
there may be a very slight summer gain for CE 
students in reading } but not in math. The 
differences core so small that they have no 
practical significance. 

o The relative changes of high achievers and high 
gainers were examined. The results of compounded 
by regression effects j but show that high gainers 
tend to lose over the summer but low gainers tend 
to gain over the summer. Such changes as may- 
exist do not seem to justify special summer programs . 

o In comparing the achievement gains of studenzs who 
attended summer school with those who did not attend^ 
no differences were found. It is emphasized tJiat 
there is relatively little instruction in reading or 
math' during summer school and that gains probably 
should not be expected. 

INTRODUCTION 

Ail groups of students show achievement growth during the regular school year, 
but what happens to that growth over the sirraer? To what extent do students 
continue to grow academically even though' they receive no formal instruction? 
We have already seen in Chapter V that during the regular school year the rate 
of growth for c^S students is sometimes less than it is for- regular students. 
It has been suggested that during the summer, regular students continue to 
improve "their achievements due to informal learning experiences / but that CZ 
students lack both the motivation and resources to engage in these -informal 
learning activities. However, the evidence" is less than clear-cut. As will 




the amoioi t 
bear ,? on 



hu dis.ju.; v.*-.\ Ut*v 4 bom have argund that, for all p&uduntn, aehiuvoaune 
suffer.', &r. abtolutu duel. I no ovor th.i tiuwir, while otW "vidanua sug .j.ss-.u 
that c: Etuiants suffer a loon ru.lar.ivu to regular students. It has fcoon 
further iruggoatad that, among CS students, fchoan who achieve th* highest gain..; 
during thd ragulat school year suffer th« sharpest losses during tho summer. 

Baaed on these ideaa , it has bean suggested, that summer school has an unusually 
important tola to play. It haa been argued that soma CS students have regular 
school -yaar learning experiences that enable them to achieve exceptionally 
high gains, and that it is important that efforts be made to continue this 
high rat* of achievement, summer schcol seeming like a reasonable way of doing 
it. Sin::o summer school classes are available to only about half of ell stu- 
dents, it has been argued that their availability should be increased, parti-" 
cuiarly for CS students. 

The remainder of this chapter examines these ideas. First, we will discuss 
the extent to which there is a "summer drop-off" and then we will consider 
the availability and effectiveness of summer school. 

THE HATUPE OF ACHIEVEMENT GROWTH OVER. THE SUMMER 

In a 1972 review of the effectiveness of summer compensatory education, Austin, 
Rogers and Walbesser (1) conclude that students participating in CE summer 
programs show "modest achievement gains." However, they point out that the 
studies reviewed generally had no control groups, and it is possible that 
"maturation" could account for the gains reported. The same review indicated 
that schcol principals and teachers believed summer school to be an effective 
learning experience. However, starting in 1976 the Stanford Research Insti- 
tute's (SRI ) educational Policy Research Canter issued a series of reports 
that raised questions about whether or not there was any maturation over the 
summer and whether or not there were comparable growth changes for regular and 
CE students. Their studies were done within the context of studying the proper 
p-ericd for evaluating CE programs. It was argued that evaluations based or. 
fall-to-spring achievement gains were less than adequate because there were 
significant changes during the summer. .Thus CE students who showed impressive 
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gains during the fa.1 I •• tu-iipc Lny tJ.iuu ported ml'/lit Inn,) mud; of t.Jv: gain during 
the tiuimmir. If tihia won.! c.r..;o, it: waa arguud, thun th<! propoj; p...'Vlm.l fai. 



evaluation way from t;ho ti a 1.1 nf oiuj yuar to t.ho fall of cTim luixt yu,w: . 

Thu aoirion of Sill ruporcr. raiaud auriomi questions that influenced policy 
regarding whothar thn fndisral government vaa appropriately evaluating it a CV>- 
funded programs, aa wo 3.1 *\a whether it ahould support efforts to incraaae 
federal funds available to auinmtsr programs . In light of the significant impact 
the SRI roaultfl were having, it was important to examine the SS5 data basic* 
relative to aumuuir achievement change. 

Is Thex'e an Abs olute Sung vgr _Loaa? 

As we have already discussed, it was generally assumed Chat there should be 
some relatively modest gains over the summer. Test publishers assume a one- 
month summer growth, and the literature generally supported a summer gain, 
Thomas and Pelavin (30) say, "However, existing research suggests that the dis- 
advantaged student has no gain or a one-month loss over the summer' 1 . It 
was suggested that CS students were given particularly intensive instruction 
during the regular school year and thus showed very significant growth. But 
this growth was thought to be ephemeral- and much of it was. lost during the 
summer. Thus CE students who had gained more than regular students during 
the regular school year lost more than regular students during the summer , 
and ended up the following fall further behind the regular students than they 
had been the previous fall. However, the 1976 SRI report was based on a com- 
pilation of state ESEA Title I evaluation reports and the data were admittedly 
less than satisfactory. 

In 1977 Pelavin and David (25) published a report based on longitudinal data. 
They obtained data from a oidwestem city, known as "City M, " which had fall, 
spring, and ensuing fall test results on the Gates-HacGir-itie reading test for 
a moderate number of CE students. The results are shown in Table VIII-1. 
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M " Grad«i F-'iuLv 
with tit I.<i.i;!f. 


alunc Hoansi fr.iv 

1." 'J CO |l Si U CVlCt' 


I'.tJadiii'j far ili'.u.l-! 
'o To 'jr. Point:;* 






LI 


t\.ai 




Fa 11 


3 




2.23 


3.29 


2.70 


•t 


931 


2,65 


3.50 


3.10 


S 


900 


'3.23 


4.30 


•1 .01 


6 


316 


3.04 


.1.70 


•1 . -1 2 


7 


120 


'1.35 


5 . 25 


.1.95 



"Adapted from Pelavin and David (25), Table 1. 

Similar results were available for two successive years. While the number' of 
cases shrank considerably; the results were similar: each fall grade-equiv- 
alent means was considerably below the mean for the preceding spring. They also 
report: results for tvo California junior high schools participating in the 
Demonstration Programs in Intensive Instruction. The number of cases is quits 
small (from 47 to 153) and the results are reported in (often misleading) grade 
equivalents. Again, students were followed longitudinally for two years. Of 
six comparisons for reading, five shovoti summer losses and one a gain; for 
math, five showed losses and one no change. From these results they believe 
that n . . . achievement gains made during the school year are not sustained, 
even until the next: fall", and say; 

"In conclusion, we urge that districts administer achievement tests 
minimally each fall and preferably each . fall and spring. These 
data would provide the capability for estimating the extent to 
which school year gains are sustained through the following summer. 
36th fall and spring tests have added advantage of allowing a 
separation of school-year and summer achievement. Although this 
information is net critical for estimates of annual gains, in is 
valuable for studying the extent and causes of summer losses. 15, . 
for example, the phenomenon is a function of the measures used, 
the standardized achievement tests, one would want to change the 
measures net the program. If it is a . result of instructional 
a- techniques that mitigate against retention, then the techniques 
should be changed. Since there are no simple solutions (for ex- 
ample, there is little research to support the notion that summer 
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school won VI allaviatu th'i auir-ner ln.v.in:i) , it: is important Ui 
b » i ah .1 u t o d a t: t * r;;vi. iwi why t h ■ i l o ; i : . u \i i : r.j i l r: in n r J i .: i: Lu d m v MLip 

a p p r op r .1 ^ t: n r a m « i d i a m . " 

ThuUM raMulta i;t>cti.i,vad wido at.'.tanu.Uiu in t;.ho govunuaan t and baoamo known an 
tho 'Suiiuuur drop-'ofd phonomona- " Tharu ara a ruunbar oi 7 rufiuvvaulonu that: can 
ba mac.li) about tha Httudiu.'j * Thay ara diMcuauod iu Uapovt 0, 



In view of tha uonuwhat: unu:<pocted ruauifca from tha SRI .itudy, otharn havu in- 
vgatigatod the aumraur drop-off phanornona, p«cantly, Hammond and Fruohtlincj 
(10) reported on tho ruaulta from a apoda! study of tha MIS Instructional 
Dimensions Study, Their results; are shown in Tables VIII-2. 

Table VIII-2 

Grade Equivcilcnt M^an Achievement Gain Scores for CK Studnnta* 



Reading , 



Grade 1 
Grade 3 



N 

395 
565 



FaJLl-to- 

Spring Gains 

1.2 
0.7 



Spring-to- 
Fall Gains 

0.0 
0,2 



Pall-to 
Fall Gains 

1.2 
0.9 



Math 



Grade 1 
Grade 3 



143 
314 



1.0 
1.2 



0.1 
0.0 



1.1 
1.2 



^Adapted fron Hammond and Frechtling (10), Table 1, 



These results show no summer losses, and shew summer gains in two of the four 
comparisons. Clearly these results are in contrast to the Pelavin and David 
findings of suramer loss. Again , hoover , the results are based cn a federate 
number of cases , although it is said that the sample was representative of 
the original sample , which was n . . . purposive ly selected for their instruc- 
tional features . " The authors point out that the sarnie car.net ^ considered 
representative of Title I reading and ssath programs. 
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Tab la VI II -3 






Moan Raw Scorua in Basic: Subjoctn by T«uit Data:] and Subject: 

(M " 739 1 v t h Grado) 


Subcmic « * 




Subj o c-r. J>L»br;.'-« t • 


Da ce of: To t 


Fair 




1, Word knowledge 


17,3 21.9 


*> 


* o 


2. Reading 


15.3 17.5 


18 


.0 


3. Language 


35.6 39.7 


41 


. 3 


4. "Language Study Skills 


9.4 11,6 


12 


» Am 


5. Arithmetic Computation 


12.7 17.4 


17 


( ? 


6. Arithmetic Problem Solving 


15,6 13, a 


19 


.5 


* Adapted from He^ns 1 Table 2.3 


• 







The table shows that there are gains over the summer in all of the reading- 
related subtests. In the math area there is a small loss in one subtest and 
a larger gain in the other. Heyns presents data from several other grades 
which show similar results. These data have the advantage of being based on* 
raw scores and thus there is no scaling problem. They have the aisadvar.tage 
of involving only a small number of all Atlanta students and represent only 
one city. Nevertheless , they do not shew the marked summer loss reported by 
SRI. 

SZS Report 3 contains data relevant to this issue. While the sample is not 
precisely representative cf the nation's schools, it is close to a representa- 
tive sample and includes large numbers of both regular and CZ students. ; 
Figures 10-1 and 10-2 show the longitudinal achievement scores for a group of 
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about 39,000 students for the fall of 1976, the soring zz 1977, and the fail 
of 1977, The number of students ranges from 7,133 to 3,412 per cohort. One 
can see rates of growth during the regular school year and &i.so see the levels 
of achievement in the subsequent fall.'* Figure VIII-1 show's that, in reading, 
students continue to grow over the summer and, for the higher grades, at a 
rate that approximates the growth during the regular school year. The figure 
further shows that in reading there is an absolute gain over the summer. 
Figure VIII- 2 , show the results for math. However, the comparison of changes 
as shown in Figure VIII-2, are quite different than for reading; on the average 
ma tli scores show only smaller gains over the summer — gains in four comparisons 
and a loss in one comparison. A possible explanation is that students gee much 
more opportunity to practice reading in -heir everyday* lives than they do to 
practice math. This is particularly true in the higher grades, and thus the 
rate of gain in reading during the summer approximates the rate for the regular 
school year* Finally, it seems clear that in these data there is not an abso- 
lute summer drop-off, instead, there is an overall gain* The data from the SHS 
v are of much higher quality than these available to Pelavin and David, and as 
mentioned, their data have a number of potential deficiencies. In contrast, th 
SE3 data were specifically collected for the study, were administered under 
known, controlled conditions, were based on large numbers of quite representa- 
tive students, and the vertical scale scores are based on fall and spring test- 
ing points. In view of the results obtained, and their congruence with the MIE 
and Heyns data, we believe there is an absolute reading gain over the summer, 
and that there is a similar, but: smaller, absolute gain- in math. 

Is There a Relative Summer Loss ? 

Next it was suggested that there was a relative loss, namely that CF students 
showed more of ' an achievement loss than rec/.'. .:. students. David and Pelavin 
(7) suggest this is the case and say (p. 4) 

^Strictly, these scores are not: for the rl summer . " Tests were administered 
about four weeks before school ended and about 3 weeks after it started. 
Report ?8 discusses what implications this may have, but it should be noted 
that this same characteristic is true of ail the data reported by Pelavin 
and David, by Hammond ar.d Frechtlir.g, and by Heyns. 
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H These studies; while extremely liroi ted , present seme evidence tha t 
disadvantaged students achieve at a slower rate than expected over 
the summer. Both conventional visdcm and the standardization pro- 
cedure of achievement tests assume that the rate of achievement for • 
all students is slower during the summer than during the school year... 
This pattern of achievement is presumed to be the same for both ad- 
vantaged and disadvantaged students: all students are assumed to 
g.iin over the simmer but at a slower rate than over the school year. 
The studies cited above suggest that this is not the case for disad- 
vantaged students. In fact, disadvantaged students' may have no gain 
over the summer or. may even lose." 

They then review their previous work and s ay , rt Together, these findings suggest 
that large achievement gains produced by compensa corv^educaticr, programs ever 
the school year may be followed by corresponding achievement losses over the 
summer - " David and Pelavin reexamine the data they reported previously and 
also include new data from the Alum Reck Voucher Study. The Alum Rock reading 
results show summer gains for three grades and no change for four grades- They 
conclude by saying, "Combined with questions raised by previous research, such 
•as inconsistencies between school-year evaluation results and the results of 
annual static-wide testing programs, we suspect that the existence of summer 
losses is quite ccmrron for educationally disadvantaged students." 

Again the MIS data are relevant. Table VIII-4 shows data for students who were 
above the 50th percentile and not recieving CS , and students who were below the 
50th percentile and receiving C 

Regarding these results , Hammond and Frechtling say; ""When G students whose 
pretest scores fall below the fiftieth percentile were compared to non-CE stu- 
dents whose pretest scores were at or above the fiftieth percentile , the lew 
achievers lost ground over the summer to the high achievers. The difference 
was statistically signf icant , however, only for the first grade. On a twelve- 
month basis the low achievers maintained their position relative to the high 
achievers because the students had higher races cf gain during the school 
year." There are several puzzling things about these data — particularly the 
vide variation in gains . It seems peculiar that r.cr.-CZ first graders gained 
only 0 .5 grade equivalents in both reading and math during the school year; . 
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Table VIII-4 

Mean Grade Equivalent Scores for Non-CT. Students Above the 50th 
■ Percentile and Students Below the 50th' Percentile* 



Reading 

Grade 1 

Non-CS Students 
CE Students 

Grade 3 



Non-CE Students 
CE Students 

Math 

Grade 1 

Non-CE Students 
CE Students 

Grade 3 

Non-CZ Students 
CE Students 



296 
344 



305 
512 



435 
97 



178 
306 



Fall-to-Spring Spring-to-? all ?all-to-?al 



Gains 



Gains 



0.5 
1.2 



1.0 
0.5 



0,1 
0.0 



0.6 
0.3 



0.5 
1.1 



0.1 
0.1 



1.6 
1.2 



0.2 
0.1 



Gains 



0.6 
1.2 



1.6 

o.a 



0.6 
1.2 



1.8 
1.1 



* Adapted from Kasmond and Frechtling, Table 2. 



similarly, why did the 3rd-grada CE reading students gain only 0.5 grade 
equivalents in reading but 1.2 gxuda equivalents in z^ith? We believe tha 
these data are equivocal regarding the existence c£ a relative sur.rr.er las 
for CE students. 



The SE5 has extensive data cn "this prcbleru We can use the sane data as 
seated befc^a on tha absolute sunder drop-off question, but break it int 
groups — those receiving CE and those not receiving CE- Figures VTII-3 ar 



264 

VTir-11 



V 1 1 1 - 4 show, the results for reading and for- math. The number of cases for 
reading varies from 1,477 to. 2,344 for CZ :;^ucen:5 and frcm 5,4C0 to 6,131 for 
r.on-CE students, The corresponding r-ir-Kibairs for math are 1,115 to 1,499 and 
6,132 to 7,061. It will he noted that: for i:he ncn-CF students in reading 
there is a lessening in the rates of growth over the sunder for the lower grade 
cohorts but very little, if any , for the higher grades. For the CS students 
there is a similar lessening in the lower grades, but, considering their slight! 
slower rates of growth during the regular school year, there may be a slight 
su.rjr.er gain relative to non-CS students. In the higher grades the CF students 
in reading drop off slightly more than their non-CE peers. For math the picture 
is somewhat different. Both the CF and r.on-CF students show a lessening in 
rates of growth over the summer for ail grade cohorts. The change for CF and 
non-CF students is very similar with, perhaps, a slightly larger drop for the 
non-CF students. Since the graphs have a number of overlapping lines and many 
may be difficult to follow, the ''same results ar e ' shewn numerically in 
Table VIII-5. 

Report 3 is based on data. from* the first and second year of the study. To 
complete the picture a special tabulation was made on data frcra all three 
years. With these data, we are able to examine the changes during two successive 
summers . Figures- 'VT.II-5 and VTII--S show the results over ail three years and 
are broken down for Regular students, Needy Regular students, and CF students. 
Figure VIII-5 shows the results for. reading and it will be seen that they are 
very similar to those shown previously. , In this figure the results for Cohorts 
1, 2, 3, and 4. are shown which means that ail grades from 1 through 7 are in- 
cluded, Aga in it will be seen that there are significant gains during ail three 
school years for all cohorts and all types of students. Over each summer there 
continue to.be gains in the vast majority of cases; in face, for 23 cf 24 curves 
shown there 'are summer reading gains. Summer gains tend to be greater in the 
higher cohorts end there may be a slightly smaller gain in the Meedy an d CZ 
scud er.es than in. the Regular students, hue any difference is exceedingly small 
_and cf nc practical sign if icance. Figure .7111-6 shews similar resulcs for math. 
Again we see that during the school year chare are large advances fcr all cohort; 
and ail types of students. There is no marked difference in the losses cf the 
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Table VIII-5 



Suirmer Gain Scores for CE . and Non-CE Students, 
(Vertical Scale Scores) 



Cohort 


Spring 1977 




Fall 1973 


Summer Ch a r. cr e 


C2 Status 




Reading 






Cohort 1-2 
C2 

Non-CS 


385 
416 




391 
427 


6 
11 


Cohort 2-3 
CZ 

Non-CE 


429 
463 




433 
476 


5 

5 


Cohort 3-4 
CE 

Non-CE 


455 
507 




456 

518 


1 
11 


Cohort 4-5 
CZ 

Non-CE 


474 
534 




477 
543 


3 
" 9 


Cohort 5-6 
CZ 

Non-CE 


497 
561 . 


Math 


501 
571 

- 


4 

10 

• 


Cohort 1-2. 
CZ 

Non-CE 


376 
395 




377 , 
400 


1 
5 


Cohort 2-3 
CZ 

Non-CE 


421 
451 




426 
451 


5 
0 


Cohort 3-4 
CE 

Non-CE 


469 
505 




463 
506 


-1 
1 


Cohort 4-5 
CE 

'Non-CE 


' 502 
552 




501 
547 


•1 

-5 


Cohort 5-6 
CE 

Non-CE 


539 
591 




543 
592 


. 4 
1 



Source: Report 8, Table 4-2 
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Reaular, Cohort 4 



Regular > Cohort 3 



Meedy. Cohort 4 
CE, Cohort 4 

Regular , Cohort 



Cohort 3 



Meody, Cohort 3 



Regular , Co he 



Needy, Cohort 2 



CZ , Cohort 1 

Needy, Cohort 1 



Year 1 ° 
Figure VIII-6, 



* ( Year 2 ° r Year 3 

Math Vertical Seals scores for Regular 1 
needy and C2 Students 
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CZ students and the cche: students, although the losses for the higher graces 
seen to be rr.ore marked than for the lower grades. Shis fin-ding is consistent 
with the idea that in the higher grades core advanced math material is being 
taught and this material is not the kind that would be practiced in students' 
everyday sunder activities. Indeed the results for both reading and math are 
congruent with the notion that the students shew summer losses or gains as a 
function of the activities they engage in during the summer. Over the s^er ■ 
there is considerable opportunity for children to, engage in reading activities, 
carticuiari'y for the older children who have become accustomed to reading from 
books. Cn the other hand students have little occasion to practice math over 
the summer and' particularly the more advanced math taught in the higher grades 
and thus we see the larger iosses/tn math among the older students* 

In evaluating these summer changes, it should be remembered that the standard 
error of a vertical scale score is about 50. It is our position that relative 
to Regular students there may be a very slight/ overall summer drop for CZ 
. students in reading, but not in math. 3ecause of the very large number of 
cases involved in each comparison it is possible to shew a few statistically 
significant chances, but f-cci a practical point of view the data do not support 
the idea of any important 1 ss for CS students relative to their ncn-C5 peers. 
Neither the SZS data nor- the MZZ data give creder.ee to any large or particu- 
larly significant relative summer loss. 

Over the Summer, 2o Hich Achievers lose More than Lew Achievers? 

It has also been suggested that CZ students who are high achievers are the 
cr.as who lose the most during the summer. Achievement is defined here as the 
achievement level of the student, net the gain during the school year— which 
vill be considered in the next section. It i* thought by seme that students 
with good academic potential profit from the increased services afforded by 
CZ instruction , . but that during the summer they are again placed in an im~ 
never is had intellectual environment and lose more of the school-year achieve- 
ments than do non-CH students, who enjoy superior summer environments.. It is 
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further suggested that children who ara low achievers gain relatively litt 
during the regular' school year, and likewise lose relatively little during 



ie 



the summer. 



The presentation here is more complicated than in 



the previous graphs 



because for each cohort two concepts are presented simultaneously, namely, 
C£ status and level of achievement . Level of achievement was defined as the 
average of the fail and spring (recommended level) test scores for the previous 
school year. This averaging vas done to achieve as much stability as possible" 
in specifying the level of achievement fcr each child. The graphs shew the 
results for the first quartile , that is, the quarter of students having the 
lowest achievement test scores, and for the third quartile. The third quar- 
tile was selected rather than the fourth quartile for two reasons. First, the 
number of cases of C2 students in the fourth quartile, by grade cohort, became 
quite small and the results were rather unstable . Second, the fourth quartile 
results, while unstable, were consistent with those for the third quartile 
where the number of cases was- reasonably large (not less than 114 for the 
smallest cell-by-cohort, by CE status). Table VIII-6 shows t w e gains and 
losses in achievement test scores over the summer for students in the first 
and third achievement quartiles. Figures VIII-7 and VIII-3 are quite compli- 
cated but are included here because they show the basic growth data for the 
school year and the summer. A number of interesting results follow from these 
data : . 

1) For reading., the growth rate for the first quartile during 
the school year is quite similar for each cohort and between 
cohorts, and the growth continu.es at approximately the same 
rate over the summer. A portion of the measured summer growth 
is undoubtedly due to regression, but, surprisingly, the amount 
of growth and/or regression is similar for both CE and rion- 

j CE students . 

2) For reading, the rate of growth of third quartile students 
during the school year is considerably higher than th?.t fsr 
first quartile students. There is a tendency daring the 
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Table. 11 -6 

Changes in Test Scores Over tie Sur.r.^;- .Ccr : 
High-Achieving Students by CE States. 



Cohort CS-Q1 Non-CS-Ql CZ-Q2 Non-C^q3 

Readina 



1- 2 11 

2- 3 8 



3- 4 

4- 5 6 11 

5- 6 7 



16 3 13 

13 0 4 7 

3 10 -1 



8 ■ -3 11 



1- 2 16 

2- 3 7 

3- 4 9 

4- 5 9 



12 



Math 

21 ' -9 ' 0 

7 ( -4 7 

9 -9 • "1 

9 -12 -9 

15 -5^-1 



Source: Report 3, Table D-l 

regular school year for CE students to grow at a higher rate 
than ncn-CE students . 

Over the surrr.er, third quartile ncr.-CE students ccr.tir.ue to grew, 
while, particularly for the higher grade cohorts , the third quar- 
tile CE students shew a less. The third quartile students should 
shew less regression toward, the sear, than first quartile students, 
but there should still be some regression for third quartile stu- 
dents. In suite of this, ncn-CZ students continue to grow over 
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Figure VTII-7. Reading Achievement hi ^ Si 
Quartila of Achicveiaeinfc £,*3 V ^J 




Figure VIII-o . Math Achievement, by C2 Status and 
Quartile of Ac hi. ever, ant: Level 
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the s umms r . Certainly for reading* the CE students in the third 
quartile show a relative loss, while the firs t cruartile cr students 
do riot — rather they show about: the same gain as first quartile 
non~CF students. 

3) For math, the first quartile students behave in much the same 
way as they' do for reading; that is, they have gains over the 
summer at abouc . the same race as school year gains, and there 
is little difference between CF and nor.-CF s tuden ts . 

4) For math, for the third quartile- students , the picture is 
somewhat different than it is for reading. Again the third 
quartile students grow at a more rapid rate during the school 
year than first quartile students, but both CF and non-CS math 
students show losses over the summer v Also there is evidence 
that the CF students lose at a greater rate than the r.on-CF 
students, but the difference-, is' not as great as for reading. 

From the above we conclude that low-achieving students continue to grow over 
the summer and at about the same rate as during the schoci year, and there is 
no significant difference between CF and non-C£ students. Cn. the other hand, 
high-achieving students grow at a higher !/ rate during the-.^chool year. For 
jjT^ading/ r.on-CF high-achieving students continue to grow over the summer, but 
CF students show an absolute loss, and a relative loss. 

Just how important this relative loss for high-achieving students .is depends 
upon where the emphasis for CF" resources should be placed. There are about 
six times as many CF students below the median in achievement as there are 
above ic . If the g^ai is to help the vast majority of CF students, car. one 
justify allocating exceptional resources to high-achieving CF students ch the 
grounds that they lose more over the s* LTmer than their non-CF peers? Cn the 
other hand, low-achieving CF students gain over the summer. Perhaps they 
would gain more if they had special summer services. 
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Ov e r t h e S urr. e r , To High i p .ers Lg s -2 >'.c re t h an Low Gair.cr^ ? 

The final variation on the cummer lass question revolves around th* relative 
loss o: high arid lew gainers. It has boon argued, that curing the regular 
school year, particularly for CZ students, those who gain an exceptional arroun: 
lose the gain during the summer. It is thought that these students need the 
stimulation of intensive instruction to maintain their gains and that lacking 
such stimulation over the summer they lose no re than these achieving smaller 
gains. 

Firs*:, we studied the gains and losses of individual Title I students -who had 
experienced che largest and the smallest gains during the regular school year. 
The st ident? were divided into four* equal-sized groups based cn the amount of 
gain experienced from the fall to spring in the regular school year. Then 
the am.cmt cf sur^r: gain or loss associated with each group was de lemined . 
Table VIII-V shews the results. 

Those students ir.g the highest measured gains during the school' yer . shew 
cuite s liable losses over the surfer. Cn the other hand, those students show- 
ing the lower 5 . z galas during the school year show equally large gains over the 
silver, .^h^se data- are an almost perfect example of the r egress ion- towar d- 
the-m^?.n phenomenon , It is weL known that test scores at the extremes of a 
distribution are ls-sr reliable thar. those near the mean . Gain scores are 
generally less riili^bie than individual tct scores, and thus even mere subject 
to regression- As would be predicted by regression effects, these students 
v/ho show very little <~ain during the school year shew a relatively large gain 
over the surfer, while -those students shewing h; gnirs during the schocl yea: 
shew relatively large losses over the sumer . These gains and. losses are 
almost certainly artifacts attributable to measurese:- r error and shew hew 
difficult it is te generalize about a trend unless both ends of the dis.ribu- 
tion a~_ considered (or one has extremely reliable measures) . 
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Table VIII-7 



Moan Spring 1S1B to Fall 1973 Tact Score (VS3) Changes for Title I 
Students by Quarter of Achievement Gain in the 1976-77 School Year 





Total Nuirier 
of Students 


Quarter 


of 1976-77 


School Year 


Gain 


Cohort 


Lowest: 


Second 


Third 


Highest 






Readina 








1-2 


1533 


22 


2 


1 


- 8 


2-3 


1506 


17 


7 


2 


-12 


3-4 


1646 


18 


2 


-4 


-16 


4-5 


lOU J 


22 


c 

u 






5-6 


1066 


23 

Hath • 


11 ' 


1 


-12 


1-2 


854 


22 


5 




-24 


2-3 


864 


30 


10 


-3 


-18 


3-4 


* 1023 


17 


0 


-9 


-24 


4-5 


850 


22 


1 


-11 


-27 


5-6 


75a 


24 


3 


0 


-22 



Source: Report. 8 , Table D-l 



There is still the possibility that students associated with the raore success- 
ful CE projects experience greater loss^j than "hose in less suco: irful projects. 
To investigate' this possibility ve determined the gains over the school year for 
each grade in" each school that contained Title I s-tudents. With the,. S3S data wa 
were not able to associate each student with a particular "pro j ect M (which is a 
very hard to define entity in actual school practice), but sine*?- /-. articular 
grades in - a school having Title I students were a veil defined uni t , where the 
Title I students wore pre bar; ly receiving quite s i;n i 1 a r instruction ... used 
grade in a school in lieu of project* The regular school year gain of each 
student in a grade was determined and from it the average grade gain was computed. 
Again, there were four equal groups of grades forced/ depending on the average 
gain of uhe students in grade. "7abie VTII-3 shews the gains and losses associa- • 
ted with each grouo 'of> grades* 
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Table VII 1-3 

Mean Spring 1973 to Tall 1973 Test 5 cor- (733) Charges by 
Four Levels of 'Project' 1976-77 5cr.ee 1 Year Gains 



Cohort 


Average >i urJb <i r 
of Students at 
Each Quarter cf 
'Project:' Gain 


Quarter 


of 'Project: 


1 School-Year 


Cains 


Lowest 


Second 


Third 


Highest 


• 




Readir.c 








1-2 


375 


12 


6 


2 


0 


2-3 


346 


a 


1 


10 


-2 


3-4 


350 


9 


2 


0 


-9 


4-5 


277 


4 


7 


2 


-7 


5-6 


223 


U 


7 


4 


2 






Math 








1-2 


136 


9 


0 ' 


-2 


-9 


2-3 


190 


17 


13 


-5 


-9 


3-4 


"' 23 2 


■■4 


- -1 


1 


-11 


4-5 




1. 


2 


-9 


-9 . 


5-6 


:■ ." 


' 13 


11 


0 


-7 



Source: Spells,. 1\. ruiaticr. re: This Report . 

Again we see tiv^ sor.e trex.ds that were seen 'for individual students. Grades are 
inade u? of students having a considerable dispersion in their scores and thus, 
on the average, we would expect less regression towards the. near, when grade 
averages are used for rat ago^dzation instead of individual scores. Also, croup 
data are- sore reliable tha.7 individual data and thus there is less change. It 
can be : seen that these grades whose students had high gains during the regular 
school year had losses over the sucrr.er, while those grades ^ whose studs ts had 
lew gains over t v : school year had surmer gains ohao were s ir.il a r to the ' tsses 
of the high-gain group- As before, the results are airvest certainly artif actual. 
It is cur conclusion from these data that high-gainers' 1 - do r.cz really experience 
losses ever the surtr.er, nor do lew gainers really experience unusual gains ever 
,-che surfer- 
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E'rom this wci.il ::h of data conclude that chare is no absolute sununor d.vcp-af f, 
but chat there may be a slight, but riot particularly significant, relative loss 
for CE students in comparison to ron-CE students. The more do called analyses of 
high and low gainers # and of members of high-gain and low-gain projects, lead 
us to believe that reported relative summer drop-off is more of a measurement 
artifact than a reality. 

5:;mms?. school and its effectiveness 

Seme have s ugge s cad tha c s tud e r. - s who h a ve no c p er f o rmed ve 1 1 du r iag ch e 
regular school year should go to summer school as an additional learning 
experience that would help them in the coming school year. It ha ia b<aen 
thought that this i:J.ght.be particularly important for CH students who are 
having difficulty in keeping up with their peers* Also, if high-achieving 
CE students lost a large amount of their school -yti.Hr gain* it would be 
particularly important that they attend summer school tr help mitigate such 
losses. Of course, summer s>: hcj.l serves functions in addition to instruction 
in basic subjects. There ar , recreational and special-interest classes that 
many students find attractive Summer school can also ser/e as a safe haven 
for children whose mothers are working or need to be away from the home. 

What is Summer School and tj/ : w "Available Is It ? 

In the SES, we surveyed the principals of b^ . ummer schools in the second- year 
sample* The average length of the summer sessions was five to six weeks, 
which means 25 to 30 school days. There were slight tendencies for large 
districts to 'offer a few more days of instruction than for small districts, 
and for medium— poverty districts "to offer a few more days cf school than high- 
er low-poverty districts. But these trends w«?rt. slight and it is appropriate 
to think o f summ-r school as lasting five cr six weeks ( saa Table 3- 12 , P.epcr z 3 ! 
The amount of reading and math instruction is not large . Cn the average there 
are about 17 hours of reading instruction and about 14 hours of math instruction. 
There is no difference in the amount of instruction as grade level increases, 
nor do Title I students receive more instruction than others (see Table 3-15, 
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school more than r.on-C.:-: students . -Jy grade cchort:, the porcantia^ of C*£ students 
who attend ranges from 21 to 32, while the percentage ;\o:\-CZ students who 
attend ranges from- 7 to 20. In terms of teachers 1 ji:d;-;men ts of need for C>.: ser- 
vices, twice the percentage of 'needy 1 students attend surfer school than the 
'not needy.' In terns of achievement test scores, those attending surr.er school 
score considerably lower than those not attending, and this is true both ar-cng 
CZ students and non-CE students (seo Tibia 3-7 and D-l trough D-5, Report 3. 

About h a 1 f of .ill students have summer school available either a: their regular- 
year school or elsewhere in the district, with larger schools more frequently 
having summer school. Schools having high concentrations of minority students 
have a slight tendency to have summer schcol more frequently. About two- thirds 
of ail summer schools are supported by Title I funds, but only a quarter are 
completely supported by Title I funds. 

The previous figures are all derived from the SES study and they are quite con- 
sistent with other reports, David (5) intensively studied the Title I summer 
programs in three states, and she found that H Th e programs average five or six 
weeks in length and generally run two to four hours per day . N She -ports that 
fewer than 15 percent of all Title I districts have Title I summer programs. At 
first glance this appears inconsistent with our findings that about half of ail 
students have sumcner school available* It must be remembered that there are many 
small and rural districts and that there is a tendency for large schools in large 
districts to have surrmer schcol more frequently . She also reports "...that the 
summer schcol program tends to be staffed by non-Title I teachers, often result- 
ing -in a staff unfajmili er with participating students. " She reports that per- 
sonnel believe strrer school to be academically effective, but also points cut 
that she has no objective data to support such a supposition. We have already 
cited Austin, Rogers and Walbesser ' s •(!) review of summer studies. They come 
to. the same conclusion. 
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In judging the' eff ectivenoss o:T HiiTjcr school it. ir, not sufficient to chow that 
utudeiita who attend surcwer school increase their porfornuncea aver the su.v,;ner. 
To measure, the effectiveness of summer school, one must compare r. tudents .who 
attended cummer school with similar students who did not attend. 

Figure VIII-9 shows the reading growth of summer school attendees and non-attendees 
for the regular school year and for the surfer, while Figure VIIZ-i: shows zho 
sane growth for math. These curves show that, for reading, hoch act--*- ' ; :-is :\:\:\ 
nor 1 .- attendees continue to grow over the surfer, and also that the su::. -r growth 
for the two groups is s imi 1 ar , For math, there is growth over the sur.rr.er in the 
lower grades but a leveling off or decline in the higher grades, but: again there 
is no greater achievement for those who attended surfer school. 

These figures luro CZ and n.on-CS students together. It can be argued that, over 
the summer, CZ students ruy perform differently. Figures VI I I- 11 and VIII-12 
shew a comparison between CZ students who did and did not attend surfer school. 
For reading it. should be noted that in the first two grades the attendees and 
non-attendees start the school year quite close together, while in the higher 
grade cohorts the attendees are the lower achievers. Almost all groups gain 
over the surner? the attendees do not gain sore than the non-attendees. While 
at first glance one nay think there is a trend for attendees to gain more — for 
ercample for cohort 1-2 — it is contradicted by another cohort — like 2-3. For 
reading there is no statistically significant .advantage as a result of attending 
summer school. For math there is a suggestion that those who attend summer 
school gain csors than those who do not, but the trend is not statistically sig- 
nificant. 

The previous data can be criticized on the grounds that attendance at surfer 
school is voluntary, and that v/hen volunteers are compared with ncn- volunteers 
from the sane school a biasing element is introduced. It can be s<ien from 
Fig-.ires VIII-9 and 7111-10 that it is the lower-achieving sr.ur,ents who attend 
sirner school and it can be argued from the evidence in ?. ! ---.5 ^3 VTII-6 

tnat lower- achieving students will seem to gain more than . a ving students 
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duo v.j f rM... ii,:>a o : r: . t'\ -Mi o.Hi-.m:'. ^ v..\w .vm- ;-;a.- oi ► S i- - = = - * JUI* 
in t:vs vly.vi;:: , -inochov o^inr^j; L\;on rjv-mp w*i;'. i" 'H^ik! . TLv.lo I :i':u l..tu . 
aclu:o.l:s th.it did not Svayo fiii:at:wr School, avaiLibl'i v/nro cai!UMVv..l tci hUkI'sh;'..; 
from 'Title I schools oL'^rln^J os. oi r hual, Tho groups of ntuid-jntr, w.ir-! 
matched :n initial levels " a^omatit , Thus two groups wuro that 

wore rrat-;hed on achievement and on b^ing Title I stud.mtrj, but: one grt up 
a--n:!od while the other could not: attend surtrr.er school. Again the \\. 
teiits shewed no significant dicforsr.co in growth between those who attended 
and rhona whu did nor.. 

In a special report Hoepfner (15) analysed the influence of attending 3i:::r.ar 
school based on three years of data. In addition to studying the changes from 
soring to fall testing, he also studied the change throughout the following 
year for those who did and did not attend surrir.er school. He reports, "for 
reading, students who did not attend reading sunder school generally gain ttcre 
in the surrrner than those who attend. The differences are not large, however. 
In the following school year, the surfer-school attendees enjoy an equally 
slight advantage in achievement gains, but there are no raajor differences assoc- 
iated with attendance or non-attendance in surlier school. In the following 
school year the sucrser- school non-attendees show siigrr.lv greater growth. 
The findings do not change when summarized by group based cn need for and 
'tieipatien in ccrrrp-ed. prograras*' 1 



All the analyses from the SES data discourage the idea that surr.rr.er schcoi, as 
it is" now conducted, is an effective rr.ee nanism for improving the performance 
of CZ students. As we ccrrrpare students who attended surrtner schools 



,c did net, we sirr.ply find that present surrrr.er schools ar- 



ret effective i 



raising test scores. But what effect should be reasonably e-<re-tsd freer* four 
or five weeks* c f instruction of less than an hear a day for reading or r.aoh^ 
Wlvar. children are rapidly rraturing in their reading skills and can have summer 
reading experiences without surrrr.er school, should we encect surrrr.er- school- related 
readinc cains? In the data there is a hint that surrrrer school in the higher 
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1 r» ma t. h , a n n i ir. com c a ri.iop, t "-3 r e 2 a 1 .1 g , 



far math-related experiences during ths suaaT.^.r- We should :.at generalize 
those rejulna by concluding that summer schccl canr.01 be errec-ivo. If su.ut; 
school were longer and had more hours, per day devoted to basic subjects, it 
might: result in achievement gains for: a t-er,does-but that is still to he 
demo p. 3 1 r ace i . 
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^mmaz^l_ 

Tfca v voce 3 3 of elementary education is ~a.de up of c nhutber of factors 
tha t i nfZ nev.cz the student f 3 acquisition o f kncu ledge . Z>i th is ~ h^ap z 
z model of the wo cos s of e I emen taz i y education is deve Icred . The mod 

^nese jaczors Z'tcvi^ae: Z'\e jevci> o~ ~ z. ± * ac^zeveme^-Zj ogg or . 

istics, coordination of inszmction, instructional leadership j and 
economic ' status . The relazionshio o f each o " the 32 ^aczors to so 

k. « 4 «* » 

achievement is considered separately and then in combinazion . it l*g 
round that: 



Z1 



a The best oredictcr of achievement at the en 



*:he achievement az the beginning . The cain in sorzna achieve 



ment over all achievement is related in complex uaus zo zhe 
remaining factors, 

0 At the student level the relationship of economic szztus zo 

achievement scores is only moderate and the relationship to gain 
scores is small but positive . 

0 Cpporzzmity-tc-lecm is considered in terms of: cmoicnz of time 
available for learning j the amount of on- task behavior > and the 
overlap between czcrzn.culurn content aid tesz conzenz. Zhe 
relationship between ovportu?ii Zy~ to -learn, and achievement is 
quite high for reading and math in the second grade for the 
poorer schools but net for the higher* achieving schools; it is 
quite high for both reading and math at the fifth grade for alt. 
schools. The relationship zo achievement gain, is more mode z*aze 
but is guite positive . 

0 Ins tru czio na I 0 rac tices 00 e r a te th ro u gh ovzer ~m.<y: i zy-zc-le ar~i z c 

influence achievement. A number of different inszruczicnal 

practices iters found to be positively related zo opporzuni zy- 
to-lecm. 
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he i:\cy -:ai::;;ht , ability to or'jan i j -\r\d ::aitu<Ainioai:e th.'.t -;u.:w.! -.}.[;■> , ability t.:< 

a learning at:iof:.;;;v.!.vo ( motiv.? ticn# ■;r , ) r..: , . , :hv far -h :. !..! 

»ii ha u 1 d a .1 ]. p 1 a y a r o 1 u in the e d u c a t i o 1 1" pmca 5 s . 0 1; ; : •. 3 r c o 1 1 V. r i b u : . :: ■, t a t : i • 
educational process are the learning material? and physical surround Lng 3 , 
including -the text books and other learning materials, audiovisual equipment, 
reading and math laboratories/ and the physic -il nature of the ciassreem, 
Aether factor is the school leadership and Tcordinatien of instruction . All 
z h o 5 a f a ccors ought to i n f 1 u e n c e t h a d e g r a a t a w h i a h a stud • : r: t w ill ^ c a u 1 r a 
knowledge during the school year, e:*.d each interacts w:.th th : » If 
understood the nature of each of these influences and the way they interact/ 
we should be able to :r.odify or influence each factor to ma:-: inu.ee the amount of 
learning of the students; 

TK2 DEVELOPMENT OF A RATIONAL MODEL Or THE EDUCATIONAL PROCESS 

In the Sustaining Effects Study we had a unique opportunity to develop an 
understanding of many of .these pro . ajses. In the study of high-poverty schools 
reported in detail in Report 15, we collected detailed information about many 
of the factors that make up the process of education. By studying the way each 
factor influences the acquisition of reading and math skills and how they 
interact, we can build a mcdei of the education process. Previous studies 
have attempted this but none have had the rich source of information on as 
large a nut&er of students and schools as available in the Sustaining Effects 
Study. 3ui.ld.ing on previous studies such as those by Cooley and Leinhardt 
(5) and Eisner, Berliner/ Eilby , Marliave , Gahen, Dishaw, . and Moore (3) and 
also our own understanding , we developed a rational mcdel of how the factors 
influence each other and work toward student growth. The model, which fecer- 
mined the data we collected/ is shewn in Figure IX-l, and consists of the 
following factors: 

Spring Achievement . In the spring of the school year each student took an 
achievement test in reading and ma th .. This te:jt was the measure of the amount 
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or know.Kx.h;.-! l!kj si'.ud-sut \\\\ .v;-;u i. red up to t:;vH*. t :.;;:•.! Tne •.■•!. w i -. .!• . ijn/d 
to account: the .v: '-p. I :.;.L tlon oi" thi.'J Juiow.l e- !;,•'■' . 'u or.! v.- ;• i. ; ; w-.j <.::.m\1 J 

-.peolfy the aaount and natuirv of all the other .':toi,\.-j of the mod-.:!., w .? ;;l\ou1 1 
b o a 1 :i 1 e t a n i: edict t h e a mo u n t o ;? >: :i o v; I e r ! cj e g .:t In e ::1 b y t ho i: ; v. i » ■: I one, e ;.; r, 1 \ a w n h y 
the soring test. If wo could do this wo would uncles: strand fcho process of 
oduca r;icn and wo could, in actual classrooms , make changes that have high 
p r o m .1 .-~ e o f i mp r o v i ng 1 e a r n i. n g . 

Athieveir^nt . In tho f -\ 1 1 the ntv.der.t ::ome:; tr? r o I vi:h a - j r i r. 
amount: of knowledge that: has been acquired from previous schooling, from homo 
and other nonschool experiences, and that; is based cn the inherent ability of 
the student to acquire knowledge, This, initial status is measured by a 
reading and math achievement test administered in the fall. The mcdei should 
allow us to explain the process by which the student's fall- to- spring growth 
was achieved. 

Economic Status. The student's fall achievement level is determined by several 
factors in addition to previous school experiences. Economic status is a 
catchall term that includes home environment and parents' encouragement and 
attitude towards education, but seems to encompass inherent ability too. The 
model assumes that this factor has already had most of its influence on the 
child and is- -reflected in fail achievement scores. 

Cpport unity-to-Laam . Opportunity- to-learn i«j defined as the opportunity to 
learn in school and does not include other learning environments such as in 
the heme. It is composed of three subcomponents. Fir so is ' T ime - the amount 
of instructional time students are present and potentially able receive 
instruction. Second is Overla p - the extent to which the content of the 
curriculum matches the content of the spring achievement test. .-j-.d third is 
Cn-task Behavior - the extant to which students ere attentive during instruc- 
tion. It is believed that the amount learned is a function of these three 



facv.::..r i t'uw: t i..: a r;!\::;-,ir;li :: :.' t: w. i. - - 1. s- * — 2 •: . 

rn:it::\U!ti,?nal rr^ticen. Sr-ocif i.a instruct i.ona.1. pr.\c:t:icrj:i th v: mako up tht.i 
factor include haw teachers allocate than* time during lo:i::;on:j .inri the 
cuality of tho.tr ciassrccm mnnagemen - . This variable Include:; kind of.instru 
tion vi" ,;: «^ - ---u:K:nti5, the amount of time spent in managing lac tru : ti .;a , the 
ams^rv: c-f t:a;\e spent l:\ ;r,a na j i g ;-r:a: /lent be ha v in .v , and the ur.eurv'. v. th«: 
ceacher spends i:i off- task activities. When teachers i;:-ir.i :.c:v! time 
instruction and manage classrooms more of f icienr.ly students will upor.d :,o:o 
time on.- task and study :,ora of the curriculum. 



Sta ff Characteristics . Staff characteristics is made up of trOse character- 
istics of the teachers, specialists, principals aad ether staff -ember':; that 
influence the kinds 'of instructional practices used. ' The staff's amount of 
teaching experience and years at a particular school are included. Also con- 
sidered is the amount and relevance cf recent training for teaching uisacvan- 
taged students. ... 

Resources . This factor includes the amount of staff time available for 
instruction, the number and variety of textbooks and other written material, 
and the amount and use of audiovisual equipment. Also included are special 
facilities such as reading or math laboratories, computer-aided instruction 
and special teaching machines. 

Coordination of Instruction. This component includes the degree to which 



curriculum concent is coordinated within the grr.de £ and frcm grade to. grade. 
It also includes the amount of coordinaticn between the regular homeroom 
teacher and tha specialist reading :r math teacher. The extent to which 
instruction is' coordinated is thought to influence the way resources ere use: 
the instructional practices used in a particular class, and the eppcrcuni ay-: 
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I. i nil (!m:i:iu,.< It: in ■•>; , :-:ni: L :i whi:h t i a t ; . t'h" 

;u.vt; t u' i o int t LjvoI In the ..it « •" i ; it.) - 

[rif.ivM.n.'lii.nri.t 1 | ,r !,:»< 1«> r |\ j m , r.U !imMU:; rn.t^.iin.tliln LluC r:.!vi n r '.no i ;,/ a 1 ' :; lni.er/i: i>: 
,md ■'iii| i >|\a.i.Li on instruction i.uvUiimooji what; t:h<*s :.m\dimt-j will Th^ 
ju* i,no Lpa L cm exert in if luenoo through a numb or of >;:h.in:i«.-.l a: tho i. nd. i or" 
Inatvuotional pv \otice:; U;;ed in th*! o 1, a.;.:. . < i n cm bo in fit i'!i*.< ?•> .! by .;■ • ! - : * t i. 
; ;;:,a::f ;i\»!i:i:;or:i who h.wo v i.: v i i. ";h.ir \-::v.-ir L , :t. , ..c:» , and tho op no f v.* in i -y • v. j ■« 1 u \ 
van \.;\ ;: lutmovd by a »;.:.:•. r that j maximum a.v.i v m t *\\.;v\ i. ; bv v.. 
instruction and that tiuj curriculum Li taught, 

TH2 RATIONAL MODEL AND HCW THb! FACTO E15 R£ LATK TO ACHIEV&M^JT a* 

The above eight:, factors are postulated as the de term! hers" of " the ninth ; Spring 

Achievement:. The analytical method used to determine the relationships among 
the different factors is known as causal analysis (see Bentler (3) far a 
review of this method) . But before discussing the extent to which the rational 
model fits the model based on the data we will present material on each of the 
factors and its relationship to spring achievement. In this way we will 
gain a better insight into the educational process involved in each factor. 
The results are based on data collected in the winter and spring of 1973-73 in 
second and fifth grade classes in 55 high poverty schools- The interested 
reader should consult Report 15 for the rationale in selecting these schools 
and grades. 

5 p r i n a Ac h i e v e me n z 

Abou c tlir £6 week s before t he end of the s choc I y a r each student r.sck a r e a d i n g ' 
and ma eh ac hi e v emenc test , The ze s c used wa s t h e Ccmp r e he n s i ve T i s t s o f 2 a sic 
3>:ilis (CT33) and the level of the test: used was the one that was judged to be 
ac -ha appropriate difficulty level for the particular second and fifth grade 
classes at o. -,chcol. The details of test administration , the meshed of 
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Fall A' , 5^.t! , /«'!.\. ,, .i". 
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Ahou". wn<\-;s :.\ J f ;nr; tho b-ijlan Lag u! tho ;i.:Sv.:ol yoar " vh .v.". 

•V!Mw::vpr;L:r:o math a;i I achievement t'S.it, 7hLi Ml t a wi; M ' i ! 

me i:;u:.'e v l- •■/... I. :: A":h i "/■..u-t. j.;. vl by T,:v> tul- :-n •■ n". - ; -.Sim 



tho frill, -:\ .j.\i.n sv^: 1 -! -oul I be :!m > m:;m.!.;v.: 1. I £ 
chived, than thasn students who gained th»i most; would have re-vlv^d the most 
propitious r.vi. :•: of the other seven components of tho model and we ".'.mid deter- 
mine tha boss combination of factors to enhances the oduc i ti::n \l i^'ocet 
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Economic? 3 ta tus 



0 



The major- criterion for selecting schools for the in-depth study wan tho 

average poverty of the students in each of the schools. Although some degree 

of scoacciic hemogsnoi ty resulted, sufficient variability remained to warrant 

including economic status in the analyses, primarily in order to distinguish 

• «■ 
school from non-school ef feces. The data on stv.dan.es 1 economic background 

were obtained from a questionnaire completed '^y each teacher-. This question- 
naire included items about parents' education and ahcuc participation in free 
or reduced-price ratals programs. These data were combined to form a stud ens- 
lave! index of economic status. A score of ICO or less indicates income below 
one Cr 3 ha a sky poveroy level.'" The aggregates used to seiecc the schools were 
based cn ail students in the schools during the year preceding data collection 
The aggregates used in one analyses were based on the second and fifth grade 
5 cud en 03 anrclled during the soudy year. The schcel acgregas-s used in the 
analysis ranged from a low of" 105 so, a high 221. The sverall mean was 15C. 

Table IM-l s'r.a^s the relaoionship between economic status and achievement. 
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•ItunViM*-. To vol 



ruuuUmj .3 1 .17 

MAl'h .20 ,:i3 -10 

(Tiradn S 

Hiding .35 .37 -07 

Math • .27 .3.1 .00 



School LovrI . 
Grade 2 

Reading .54 .67 .40 

Math *40 .61 .27 

Grada 5 

Kaading • *65 .62 .14 

Hath .51 .53 .19 



* T ha n um b e r o J: a tud e n t r> £ o r t: ha student level co r r o 1 a tr. i o t \ g r an g e s f r; rn II , 7 E j 3 
to 3,232, tha -number cf schools in 55 in. all casoa. 

Source: ?,eoort 16, Table 3-1 * , 



QvO 



.ill., i. t.\i. 1 ■'. : : 1 r ■ ' ! 1. -t - !.. ill i ;i i! •■■»! i , : 1 , '.,M ! ; j r. 

a' ,iur: , ",7 , i ' i j f : ' ;n >!. c' .'."» = 1 « i n i ^. i -i 

i \ . \ * ' ; i i, i <U 1 '/ * „l. • lu •■ .1 : ■ i i 1 i ' *; i '■ ::' -\ - ■ i • I ' ■ i . 1 1 1 a - ' !■ " :i 

.v.'-j '!i ■nii'.li:', th'i iVuv.t »h. -'!'. , H , i: 'vi!. 1 



I :\ t;>> ;:l.:;".h ■ \ !m .i:,a ■ '■(;;<•'./ 1 i i". i !. !. ' 
i.iuulLar .i.n::lu»in.::a on ,K:hi,ov»':UM;\ f. th'i l\t;,'h"V "jr !«' i ".ban a". thn I, -.wi*?: :\\>\ \, 



It w.u thought that • !-: ■-. „»l.-j :.;tatu:.; :;iL;hU r«> t .:-."! *:a ■ >im:o :u ty~ V) 4e .i r.n 
ba.ied on tho L.l-.t v ::h-K school* havlivj Su^h-::: i; ■: i : r^ttiu ;.: v.' \\\ v. ;:ujht 
of for bettor educational oppor tuniti.o:i . Thu.i eu^nami. *: si tatu /. . w,i : on rre lata* 1 
wish instructional cbo, on-taa!-; bahavior, and te at -aurr i::ulu;a overlap, but; 
the resulting correlation:: were sin :ni.:<!.:;d and of such rr.^.jnitvy.'.n that no 

p ;i z z >.i r n - c u .1 ;1 b «-i joon, 



In cc-atinui::cj cur Gxplorasian cf each of th.o fj.cucrn -ihovn i:; r'irjur^ I 'A - 1 , wo 
sots that cppor -tunity-tc-laarr. v-, tho factor that loadrj directly to ^?ri:ig 
achievement and that ccordir.a tion of instruction, instructional leadership 
f.rvd i n s cru c t i c n a 1 practices all influence achieverr.sr.t throutjh optcrtun i ty-to- 
1 o a rr. . defined epper tu n i ty - 1 o - 1 -3 a rn a s t h e ar.au n t of t i .t. *j t h a t z t u a ^. n t ^ 

are pre^ant r. :1 atta -.-iva tcj lessens that ara reic-ant ta aha a-j : i a . The r e a r -. 
three, part 3 cf this _.afinitacn that wo ware able to r.o - .r,:. : 

Tina - the anount af Lr.atrv.j ti c.nal tar.e studa.-.t- A . :: -J preaant 

Cn- task H a h a via r - t he e:c ta t tc whi z h s lu da n t a are a a ta :: z i v a :: ur in a 

lessons 
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- the extent to which the content of the spring achieve- 



^er^^ksi-TOatches-the-^-ontant of the curriculum. 



The concept of oppo r tun i ty - to - loam refers to the opportunity at school. Of 
course there are also learning opportunities outside of school. These are 
thought to be represented by student's Economic Status, where it is assumed 
chat more advantaged children spend mere time at home engaged in educationally 
r eleven u activities* 



It seems obvious that as students spend more time at learning activities they 
should learn more. Starting with Wiley's (33) studies and including many • 
others, it has been shown that there is a relationship between amount of time 
spent learning and achievement, but the relationship does not seem to be as 
straightforward as might be supposed. There are several ways of measuring 
learning time. The simplest is to determine the number of days school is in 
session, or this can be corrected for time missed due to absences and special 
activities. Another way is to ask teachers how much time they spend in a 
typical week giving instruction in reading or math. Still another way is to 

observe .classes and record__how much time is actually devoted to instruction 

We tried all of these methods and did not find them to be as strongly related 
to one another as expected. In Report 16 (p* 2-13) it is reported that the 
correlation between the teacher's reports of the amount of time stent teacriing 
reading and math and the amount observed in the classroom was only about .25. 
While the relationship between observed time in instruction and spring achieve- 
ment was generally positive, the correlations were generally small. Similar 
results were obtained when the. meast.ure of time was based on the number of days 
the school was in session between the fall and the spring tests. Table IX- 2 
shows the correlations with achievement for both measures of time. 




Table IX- 2 

relationship Between Two Measures of instructional. 
Tine and Achievement* 



Fall Vertical 
Scale Scores 



Spring Vertical 
Scale Scores 



T ine Based on Observed Class rccn In struction^ 

Gain 



Grade 2 
Heading 
Hath 

Grade 5 
Heading 
Math 



Grade 2 
He ading 
Math 

Grade 5 
Heading 
Math 



.04 
.13 



.12 
.05 



.04 
.27 



.26 
.16 



, 22 
1 1 



.23 
.17 



Tine Based on n« c r v l0g ,l Cavs better. Fall and Serine Test 



.13 
.01 



,26 
.25 



*3ased en 55 schools. 

Source-. Report 15, Tables 2-4 and 2-5 



.27 
.30 



.26 
.21 



.21 
.24 



.03 
- .02 
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Cn— Task. Behavior 

The second part of opportunity- to-learn is on-t.sk behavior, that is the 
-veraca nroccrcicn of students actually attending to the instructor, oerr.g 
given. Assessments of the on-cash behavior of ail students in each instruc 
clonal group were sade at five-ninute intervals chrcuchcu 



With each assessment, observers recorded the total number "1 3 tune 



ach lessen rose rve'j 
3 in the 

r.s true clonal group who vera present, as well as the number =f students en- 
cash, in general, cn-tash behavior referred to activity directly relates to 
che accuaaiticn of subject-matter information. Students were judged to he., 
off-task when engaged in ncn-ccgnitave activities, even when she teacner 
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assigned these activities. Based on these observations it was determined that 
students were on- task about 79 percent of the lesson tine . This figure was 
about the same in the second and fifth grades and in reading and math. Table- 
IX-3 shows the relationship ' between observed or.-task behavior and achievement. 
It will be seen that while the correlations are rather small they are ail 
positive. (These correlations are for the total instructional unit rather 
than for each classroom; that is they are for the unit of ins true tier, which 
had a cordon set of students, teachers, and sub j ect *ma tter . ) 



Table IX- 3 

Correlation of Amount of Cn-Task Behavior and Achievement* 





I 4 a 1 1 A c h i e v em en t S 


or in a Achievement 


Gain 


Grade 2 








Reading 


.07 


.11 


.11 


Math 


.08 


.12 


.12 


Grade 3 








Reading 


.05 


.06 


.05 


Math 


.07 


.10 


.02 


dumber of Total 


Instructional Units varies f rcn 


322 to 642. 





Source; Report 16, Table 2-3 . 



Overlap of Test Content and Curriculum 

In Chapter V we presented a discussion of the way we measured the extent to 
which teachers reported they had acutaily taught the material that was con- 
tained in the tests. A high degree of correspondence was noted between the 
knowledge the cases measured and the material the teachers said thev taught 
This measure of overlap is the third element making up opcortvjii ty-to-Iearn 
We determined the relationship between overlap and achievement for two 
different sees of schools. It will be remembered that each grade was admin 
i s t e r e d the form of the - a c hi e v em e n t test estimated to be the most suited to 
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level of attainment 



In 20 of the high-poverty scncols tne 



1 



rom o: 



he test was giver, in the -fifth grade and in 



: h e r : r. a i n ir.c ■ :: s c c o I s 



the more appropriate, harder, level 2 form was administered. Thus ir. a 
number of analyses in Report 16 the analysis is done separately for these two 
sets of schools. Table IX- 4 shows the relationship between the percent or; 
curriculum overlap with achievement for these two groups of schools. Again 
the correlations are based on total instructional units in each schec ~ . 

Table IX- 4 

Correlation of Curriculum-Test Overlap with Achievement * 



Test level 1 Schools 



Test Level 2 Schools 



• Fall Spring Fall Spring 

Achievement ; Achievement Gain Achievement Achievement G 



Grade 2 
Heading 
Math 

Grade 5 
Reading 
Hath 



.10 
.26 



,29 
.29 



.10 

.25 



.33 
.36 



-.01 

-04 



.12 
.14 



.33 
.13 



.19 
.21 



.35 
.25 



.27 
.16 



*Total Instructional Units-- vary in number from 139 to 374. 
Source: report. 16, Table 2-12. 

It will be seen that almost all of the correlations between achievement and 
the decree of overlap between curriculum content and test content are positive 
and vary from quite small to modest. One might think that these correlations 
should be larger but: their size tends to emphasize the fact that there are 
many c recesses determining achievement and that while teaching test: concent 
is important, there are many ways students learn the material en which they 
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;ehavicr , and tne amount: c 
-e a sure of eepcrtuni ty- to- 



o <^ -** — . . ^ >" - V « *j» * um overlap 
iam was made uo cf the 
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overlap, the percent. of students on-task, and the time in instruction . " Table 
IX-5 shows the correlations between the achievement test scores and the sum- 
mary measure of opportunity to learn. 



Table 

Correlations Between Opportunity-to-Learn and Achievement 



Grade 2 
Beading 
Math 

Grade 5 
Heading 
Math 



Test Level 1 Schools 1 



Fall Spring 
Achievement Achievement 



.76 
.75 



,31 
.36 



.69 
.66 



,62 
.41 



.25 
.28 



.27 

.09 



Test Level 2 Schools 1 



Fall Spring 
Gain Achievement Achievement Gain 



.02 
-.02 



.51 
.21 



.05 
.14 



.62 
.27 



.09 
.22 



.50 
.10 



♦There were 20 Test Level 1 Schools and 35 Test Level 2 Schools. 
Source: Keport 16 , Table 2-13. 



Inspecting Table IX-5 it will be seen that the correlations vary from sightly" 
negative to quite high positive. First it should be remembered that these 
correlations are fairly unstable because they are based on a small number of 
cases. Similar correlations were computed where opportunity-to-learn was 
based on the measure of time using the Instructional group as the unit of 
observation and also on this measure aggregated to the school level. The 
relationship of these measures with achievement also varied considerably/ with 
the school-level correlations Seing of the same order of magnitude as those in 
Table IV- 5 , while those for the toal instructional group were considerably 
smaller. As will be seen later, the validation of our educational process 
model was difficult because of the type of variability we see in this table. 
Nevertheless, it seems that the vast majority of the evidence points to a 
fairly positive relationship between the composite opportunity- to -learn and ■ 
achievement, ' 
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Instructional Practices:/ Allocation of Teacher's Time to Instructional and 
Mo n- Instructional Activities 

Instructional practices are activities that teachers engage in with their 
students in the classroom. Cur measures of these practices come from observa- 
tions of the instructional groups, from interviews and from questionnaires 
completed by the teachers. 

In tne classroom, teachers must spend their time on a number of different 
activities, including instruction, making and collecting assignments, handling 
disruptions, and attending to housekeeping activities. Through the observation 
of teachers. in their classrooms and instructional units, we classified their 
use of time as:. 

instruction - conveying information to be learned through explanations, 
questions, or the monitoring of student understanding. 

Instructional Management - activities that manage the flow of instruction, 
such as giving assignments, handling material and equipment, and check- 
ing and recording completed work. 

Behavioral. Management - activities related to controlling behavior, such 
as, admini s tering d isci pline t _ setting classroom standards, and monitor- 
ing directed at maintaining -order . ~ ~ 

Off-Task - activities with no apparent connection to instructional 

objectives, such as absence from' the classroom, lunch-money collection, 
and personal conversations- 

Observers recorded the time teachers spent in the last three activities,, and 
time in instruction was taken as the remainder of the total lesson cericc. 
The estimate for each type of activity was converted to a percentage of the 
total lesson period. O'er all grades and subjects it was found that TC% cf 
the time was spent in instruction, 19V in instructional management, 2 is in 
behavioral management and 4% in off-task activities. Generally there is net 
much variability in time allocations between reading and math, different 
grades, or level 1 and level 2 schools. Gf course there is considerable 
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variability from classroom to 'classroom . .The way in which teachers allocate 
their time should be related to the activities engaged in by their students . 
Since the goal of instruction is reached through student on-task behavior, we 
investigated the relation between the way teachers allocated their time and 
student on-task behavior. We found that over all grades and subjects the 
correlation between teachers' time spent in instruction and student on-task 
behavior was .30,' that between time in instructional management and student 
on-task behavior was -.21, between time spent: in behavioral management, end 
student on-task behavior was -.43, and between teacher off-task activities and 
student on-task activities was -.09. It will be recalled that, in an absolute 
sense, teachers spent relatively little time in behavioral management, but it 
has the highest correlation with student on-task behavior. Behavioral manage- 
ment problems seem to spread; when the teacher disciplines one student, this 
often distracts other students from their assigned tasks. Also time spent in 
instructional management takes time away from instruction and. tends to give 
students ah opportunity to go off task. Due to the interaction of these items 
it is clear that the teacher who organizes instruction efficiently can maximize 
the time spent on intaraefc^ en and thereby increase student on-task activities . 

The way teachers spend their time is related to classroom management practices. 
The observers rated the teachers on cognitive monitoring, that. is how well the 
teacher assessed student understanding. They also rated them on on-task 
monitoring/ that is the efficiency with which the teacher handled student off- 
task behavior; and they rated them on organization of activities, which refers 
to the degree to which there were- routine ways of dealing with recurring 
situations. While conceptually these are separate activities, the inter- 
correlations among them were so high that we formed one scale called classroom 
management. The correlation between this measure and student on-task behavior 
was .65. The correlations of classroom management with teacher time in 
instruction was .29, in instructional management: -.14, in behavioral manage- 
ment -.49, and in off-task activities -.13. Thus we see that teachers who 
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have good classroom management allocate their time well, which results in 
students on-task. It is apparent that * teachers can substantially affect the 
amount of time that students attend to learning activities. ' In further 
analyses it was shown that the quality of classroom 'management is more in- 
fluential than teacher time allocation in predicting student on-task behavior. 

"In trying to understand how student on-task behavior could be increased, the 
sources of off-task behavior were examined. As previously noted, students 
were off-task about 21% of the time. If this, figure could be reduced signi- 
ficantly there should be an important increase in amount learned. Leinhardt, 
Sigmoid, and Cooley (21) have argued that an increase Of as little as 10 or 15 
minutes a day in silent reading would significantly increase performance' for 
disadvantaged students. We examined the sources of off-task behavior and they 
are presented in Tabl£'IX-6. 

It can be seen that about one half of all the off-task behavior is under the 
teachers* control arid even the largest category, Solitary Student Activities-, 
would be under teacher control if the student were highly motivated. The 
coint is that teacher s""have~att~'''oppa 

behavior by organizing their activities and using good motivating techniques. 
The methods teachers use to motivate students were classified into four 
categories: 

Motivating students with appropriate materials 
Motivating students with rewards based on accomplishments 
Establishing a warm, positive relationship with students. 

Threatening or punishing students . ' .* ■ 

In the teacher interview we asked teachers to tell us the kind of techniques 
thev used to motivate cheir students. About 45% of the teachers mentioned 
the, use of interesting and appropriate materials; about 20% mentioned using 
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Table IX-6. 
' Sources of Student Off -Task Behavior 







Type of GrouD^" 






Pew Students 


Some Students 


Many Students 


c. 

• 


Off-Task 


Off-Task 


Off-Task 




% 


% 


% 


Largely Under Teacher Control: 








Teacher Initiated Distractions 


4 


6 


9 


Lack of Assignment 


5 


9 


13 


Distraction by other Students 


23 


27 


32 


Somewhat under Teacher Control: . 








Handling Materials S Equipment 


6 


8 


7 


Changing Activities 


1 


1 


1 ° 


Not under Teacher Control: 








Outside Interruptions 


8 


5 


4 


Solitary Student Activities 


51 


45 


35 


TOTAL' 


*100% 


101% 


101% 



"Few students off-task =* 7% or fewer off -task. 

Some students off -task - More than 7% and less than 35% off -task. 
Many students off -task - 35% or more students off -task. 



Source: Report 16, Table 3-7 ^ 

rewards based on accomplishments; about 20% mentioned establishing a warm, 
positive relationship; and about 30* mentioned the use of threat and punish- 
ment. (The percentages add to more than 100% because more than one answer 
was allowed.) We observed the kinds of methods being used in the classroom 
and found that these often differed from the methods teachers reported they 
used. There were only very modest correlations between the kind of motivations 
teachers reported -they used and the frequency of on-task behavior in the class- 
room. Thus we were unable' to suggest any one motivating technique as being 
particularly appropriate. We also explored a number of other teacher practices 
to see if they were related to on-task behavior > We examined the use of lesson 
plans, the frequency of feedback of information about student strengths and 
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information about student strengths and weaknesses, the individualization of 
instruction, the use of subgroups/ and the use of a diagnostic-prescriptive 
.approach to instruction. Among the approaches/ the use of lesson plans was 
the most .related to on-task behavior, but that correlation was only .09. 

The final classroom practice to be examined is the amount of direct supervision 
or the amount of teacher-student interaction. Some teachers divide their 
classes into subgroups and instruct each one in turn. Some teachers also have 
an assistant who works with individuals or certain groups while the teacher 
works with others. Depending on both these factors — how the class is sub- 
grouped and how many staff give instruction — none, few, or many of the students 
may work independently during ' little or much of the lesson; the others are 
being supervised . We refer to the measure based on these two factors, sub- 
grouping practices and level of staffing/ as level of direct supervision. 
However, it may also be useful to think of it as amount of teacher-student 
interaction, especially since other researchers have obtained promising results 
by analyzing differences among classrooms in terms of differences in amount of 
interactive learning activity (Stailings, Needels, and Staybraok (28)). Either 
conceptualization fits the measure that we will now describe. Data for asses- 
sing direct supervision derive from observers 1 estimates of the percent of 
each staff member's time spent with different-sized subgroups. Observers 
. reported' the total" minute's" each staff person was present, along with the per- 
cent of that time each staff - member spent off -task or working with individuals , • 
and working with subgroups of different sizes. From these estimates, we con- 
structed an index of the average percent of students in the instructional 
group who were directly supervised during the lesson. 

Table IX -7 summarizes the relations of direcr supervision to student on- task 
behavior, and to two teacher -behavior variables — time in instruction and 
quality of classroom managment:. These relations indicate that, in general, 
the iiore teachers directly supervise their students: 
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• the mora those students are attentive to learning activities; 

• the higher the' quality of their classroom management; 

• the more lesson time teachers spend giving instruction. 

Table IX-7 

Correlation of Percent of Students' Direct Supervision and 
On-Task Behavior/ Quality of Classroom Management, and 
Teacher Time in Instruction 



All Schools 

Correlation of .Direct Supervision and : 

Percent of Students On-Task .30 
Quality of Classroom Management -.19 
Percent of Teacher Time in Instruction .29 



For all schools there were 1,219 students observed. 
Source: Report 16, Table 3-14. 

Before we comment on' the implications of these findings, we note that they 

accord well with impressions we formed from reading observers' narrative^ 

reports. Also, during their scans of student behavior, observers recorded 
the assigned activities of students who were off -task. Though this informa- 
tion was not tallied, our impression is that assignments to be completed 
independently were much more likely to be associated with off-task behavior 
than assignments that involved working in groups with the teacher. 

The following narrative gives a flavor of how students behave in these non- 
supervised situations* The instructional group described is a" fifth-grade 
math class. The 24 students are working independently on assignments from a 
ccmputier -managed., commercially available system* An aide divides her time 
between two small groups of three students each. The teacher never monitors 
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^^£^ a .gs^s^_^qlei -but assists individual students whom she calls to her 
desk. As the observer described it: 

Through the rest of the classroom, general chaos ensued. There 
were children fighting in the corner, talking to each other. One 
child was up on top of the desk, another child tipped over a whole 
stack of papers on the floor and spent a great deal of tine on the 
'floor playing with them, and children came and went at will around 
the room even though it 'appeared that the majority of the time it 
had nothing to do with the directions in their lesson. For example, 
they were walking over and talking to ether students and then 
returning to their desks. Or, walking out of the whole ciassrcom 
area but yet not having amy papers whatsoever in their hands. 



The observer comments : 

When the aide was at the first table, all of the students were on- 
task, but as she moved over to the next table, the students that 
she had formerly been working with went off-task for about 75 percent 
of the time when she was gone . . 

and, further: 

If it hadn't been for the presence of the aide who worked with 
six students during the lesson, the only students who would 'have 

..-had seemingly any i nstSTic^on^a t all . . . were the sixteen 

students that the teacher worked with individually at different 
points during the lesson . . . (but) they only seemed to remain 
on- task while she was actually working with them. 

Although this example may seem extreme, we have others like it, and the situa-. 
tion — off-task behavior associated with lack of direct supervision — seems to 
be quite common. A more detailed breakdown shows that lack of supervision is 
more strongly connected to lack of a ttentiveness to learning activities in 
second grade, especially in reading. The direction of these differences is in 
accord with the notion that younger students are less able to work on their 
own . 
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Turning now to the implications of these findings, it seems relevant to say 
that though weaker than the relations of quality of management to students 1 
on-task behavior (Table IX-7) , they are in a sense more impressive. For being 
more ' explicit , they are more directly interpretable . These data show that 
teachers who arrange their instruction so as to directly supervise greater 
proportions of their students are more successful in keeping students on-task. 
In practice, this means that teachers who teach to the whole class or to 
larger subgroups will have students who scand greater amounts of their time 
in learning activities. Subgrouping that results in more students working 
independently is likely to lead to students not engaged in learning activity. 

One cannot, of course, conclude that whole-class instruction is better than 
small-group or individualized instruction in every situation and for outcomes 
other than on-task behavior. However, the above analyses, as well as studies 
by others, do suggest that a very important ingredient in successful small- 
group or individualized instruction is the number of staff. In the next 
section we will take up questions of staff resources in more detail. 

Resources 



The next component in our mode~l~nof-^Ticati~onr~i"s^e^curce3 . — By~ jfe"sources~ we' " 
mean the number of teachers, aides, clerical assistants, texts 'and other, 
material, and audiovisual equipment available for use in instruction. We 
believe that resources act: through instructional practices to increase 
opportunity-to-learn - 

Staff -Student Ratio * 

Y;\ ' 

During their observations, data collectors rioted all persons who were present 

\ 

and had instructional responsibilities with the group being observed. Each 
staff member was /classified » as regular, specialist or aide, and the total 
number of minutesyjach one was present was recorded. These data were the * 

4%: 
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basis _for_„.the._.construction, of- the paid staff-student ratio The-staf f -student 

ratio was the amount of staff time spent in instruction divided by the number 
of students present during the instruction. The ratio corresponds to the 
number of staff minutes available per student, per hour of instruction. ■ 
Typically, there were about seven and one half minutes of staff time available 
for each student in an hour of instruction. There was slightly more time 
available in reading instruction than in math instruction . It also was found 
that thrre were generally more instructional resources being devoted to low 
achievers chan to high achievers. It is usually assumed' that a staff-student 
ratio" ti. - allows more time with each student is associated with favorable 
classr characteristics. Table IX-3 shows the relationship between staff- 
student jwc " and a number of these characteristics* 



/ - Table IX-8 

Correlations of Staff -Student Ratio with Classroom Characteristics 





Cl*««roan Cuxactvri sties 
P«c«t ct of Qualify o£ L r^J' 
. 4 .~ — Ia»wrae*i<3n — — o< S*urf«ncx — 






All firmdM *nd {1#al9 , <as #I1 .27 .30 ' 
Subjects c 





Source: Report 16, Table 4-4 • 



It will be seen t.iat as the staff -student ratio increases, the percent of 
students' on-task increases, and also the percent of teacher time spent on 
instructional activities increases, as does the quality of classroom managemen 
and the level of direct supervision of students. All of these characteristics 
are generally considered good classrocm. practices and presumably result in 
greater opportunity- to -learn. 
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Use of Equipment and Materials 

Another resource that influences instruction is the amount of equipment and 
materials used during instruction. There is a surprising variety of such 
materials used, as illustrated by the following table. 

Table IX-9 

Equipment and Materials Teachers Report Using 



aaadlAq 






Math 


Equlpamnt 


aatarlala 




XqulpaMnt 


aatarlala 


• tapa racordar 


• tastbooaa, raadar a 


• 


Caps racordar 


• tastbooaa 


a record player, radio 


• aappl— nf iry raadar* 


• 


racer d playar, radio 


• raferenca booka 


• allda projector 


• rafaraaaa booaa 


• 


•lido pro j actor 


a ocarlfcbooaj 


• Mvla pro j actor 


• fciaa reading bnki, 


• 


(ila projector 


• ditto a 




— girlnaa, aa^ipapan . 








• fULa atrip projector 


aaalci 


• 


opaque projector 


a aaaea, puaalaa, flash- 










carda, amaipulaolaa . 


• opaqua projactor 


• wnrrfchwofca 


• 


overhead projector 


counting and ae*iurlA9 










devtcaa 


• ovarfeaad projactor 


• tlttoa 


• 


television 












a proaraaawd taxta and 


• talarialon 


• ftaii, puaalaa, 


• liataaina cantor 


puftl laftara' lit* 




flaahrarda 








• llflCMlAf can tar 




• 


alectroalg calculator 


a vlaviel aid*, cJiaxta. 




• individual raadlAa; 






teacher e«d« Murl- 


• faarthirt ta*chlna 


Llta or mui loclud** 


• 


eoaputar terainel 


ala 




iaa) ptocrt— id taxta 










aad puaXUoara' Uti 


• 


feedback. taacsUia 




• controlled r^cUn, 






aar hi no 




apaod raadar 


a> viaaal alda, cftarta, 








a cypaiclter 


picturaa. taacoar- 
■ad* ami aria la 








ay aaapatar ttnUal 











Source: Report 16, Table 4-8. 



Perhaps the most striking aspect of equipment use is that the most intensive 
use occurred in. the context of compensatory and remedial education. This is 
supported by the generally negative correlations between amount of equipment 
use and fall achievement scores, which are. about -.10. r When the relationship 
between equipment use and achievement gain for the year was examined, it was 
found that the relationship was negligible for all grades and subjects, except 
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for 5th grade math where there were positive correlations of .21 for low 
achieving students and .24 for regular students. Why this unusual result for 
fifth grade math was found is hard to explain, but it should be noted that 
frequently throughout the results of this study, fifth grade math seems to 
give stronger relations than any other subject or. grade. It is possible that 
fifth grade math starts involving more abstract concepts than other grades 
and that different practices and materials have. more effect on abstract 
material. 



The correlations between the use of equipment and materials and student on- 
task behavior were insignificant. Similarly, the relationships between 
equipment and materials use and the opportunity-to-leam components — on-task 
behavior, test curriculum overlap, and instruction time — were all slightly 
negative to insignificant, as were the percent of teacher time in instruction 
and quality of classroom management. Generally we found that there was 
substantial use of a wide variety of equipment and materials but we failed 
to find this use" significantly related to classroom practices or to achieve- 
ment gains. 

Staff Characteristics 

Another of the factors making up the model of the education process is staff 
characteristics, thought to affect various instructional. practices that 
influence opportunity-to-learn. The main staff characteristics measured 
were teacher's amount of experience, training, and job satisfaction. Similar 
measures were obtained for principals. 

Teacher Experience 

The regular teachers at the 55 high-poverty schools had an average of just 
over 11 years of teaching experience, of which a little over seven years was 
at the school in which we observed' them. CZ specialists had slightly more 
teaching experience than regular teachers, averaging a little over twelve 
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years but about the same amount of time at their present school. There were 
small but positive correlations between the amount of teaching experience and 
students' achievement. These relationships are confounded by the fact that 
in these schools the more experienced teachers tend to be assigned the lowest 
achieving students who tend to show the least improvement. Our results show 
that relationships between years of experience and student gains are stronger 
for regular teachers than for specialists. But in interpreting this, we need 
to keep in mind that the specialists usually teach the lower achieving students. 
In considering the " relationship s for second and fifth grade and for reading and 
math (for all teachers combine'/ the correlation between years of teaching 
experience and achievement gains ranges from 0.7 to .25, while for the regular 
teachers the correlations are from .10 to .32. 

We also investigated the relationship between years of experience and the 
factors making up oppoptunity-to-leara. • Generally there were very small 
negative relationships between years of experience and student on-task behavior, 
there was essentially no relationship between amount of time in instruction and 
experience, and there were small to moderate positive correlations^ between 
experience and test-curriculum overlap. These latter correlations suggest 
that as teachers become more experienced they tend to cover curriculum that is 
included in the test of achievement. We also investigated the amount of recent 
training in relation to student achievement. Generally teachers who had the 
most recent training were assigned to the lower achieving students. Neverthe- 
less, in the fifth grade, there were positive relationships between the amount 
of recent teacher training, and student gain, about .12 for reading and .22 
for math. 

Job Satisfaction 

Teacher satisfaction was assessed from both interviews "and questionnaires. In 
the interview, teachers were asked to rate their work relationships with other 
teachers who taught the same students, with other teachers in. the same grade, 
with the remaining teachers, and with the principal. In the questionnaire they 
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were asked to evaluate the school as a good place to work, the extent to which- 
teachers at the school worked well together, and the effectiveness of- the way 
conflicts were handled. Based on both sources of information a teacher satis- 
faction scale was produced. Table IX-10 shows the relationship between teacher 
satisfaction and student achievement. 





Table IX-10 






Correlation of 


Teacher Satisfaction and 


Student Achievement 




School Level (N=5S) 


Fall Achievement 


Sorina Achievement 


Gain 


Grade 2 
Reading 
Hath 


- - 26 

.12 


.33 
.21 


.30 
.16 


Grade 5 
Reading 
Math 


.33 
.41 


.43 
.41 


.32 
.17 



Source: Report 16 , Table 5-8 



These correlations between teacher satisfaction and student achievement are 
impressive and are consistent with a number of other studies which have 
obtained similar results (see Report 16. for references). It is possible that 
these relationships are circular; that is, teachers are satisfied when their 
students do well, while at the same time satisfied teachers do" well and so do 
their students. It has also been argued that satisfied teachers have students 
of higher social status, who do well because of their better preparation, and 
.thus the teachers are more satisfied. In an attempt to understand these 
relationships, some analysis was done using partial correlations among teacher 
satisfaction, economic status of the students., and student achievement. The 
results showed some interesting grade differences. At the 5th grade, the 
relationship of student socioeconomic status to teacher satisfaction disappears 
.when fall achievement is controlled for. In other words, student background 
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exerts no effect on teacher satisfaction independent of student fall achieve- 
ment. At the 2nd grade, however, both factors appear to have some effect. 

Teacher satisfaction has a small positive relationship with percent of stu- 
dents on-task; satisfied teachers spend less of their time on behavioral 
management, and have a higher quality of classroom management. Also the more 
satisfied teachers have a considerably higher test-curriculum overlap. 

Principal Characteristics 

Principals' experience varied considerably, ranging from completely new prin- 
cipals to those who had served many years. Both the amount of experience as 
a principal and the number of years at the particular school under study were 
associated with student achievement as shown in Table IX- 11. 

First, it should be noted that the more experience the principal has, the 
higher the student achievement gain. But it should also be noted that there 
is a positive correlation between years of principal experience and the fall 
achievement scores. This argues that the more experienced principals are 
assigned (or choose) the schools with higher achieving students and corres- 
pondingly, schools located in more affluent/sections of the community. Since 
greater principals 1 experience is associated with larger student achievement 
gains , we would expect principals' experience to be related to a number of 
classroom practices, but generally this is, not the case. We explored the 
relationship between principals 1 experience and the opportunity-to-leam 
components and they were generally very low and mixed in direction. 
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. Table IX- 11 

Correlation of Principal's Experience with Student Achievement 



• 


Pall Achievement 


Spring Achievement 


Gain 


Years as Principal 








Grade 2 








Reading 


.10 


.32 


.29 


Math 


.14 


.25 


.14 


Grade 5 








Beading 


.09 


.16 


.18 


Math 


.15 


.30 


.29 


Years at Study School 








Grade 2 








Reading 


.14 


.19 


.09 


Math 


.16 


.18 


-.03 


Grade $ 








Reading 


.18 


.18 


.04 


Math 


.22 


.32 


.25 



N-55 

Source : Report 16, Table 7-1 

Coordination of Instruction 

In our model of ' the education process, coordination of instruction is thought 
to operate through the coordination of use of resources, through the operation 
of instructional practices, and through the factors of opportunity- to- learn. 
Coordination of instruction refers to the sequencing and relating. of learning 
tasks, and was measured by how much teachers knew about each other's instruc- 
tion, as indicated in interviews. it is also related to how much teachers 
plan instruction together. The importance of coordination of instruction is 
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reflected by. the fact that about 40 percent of the students have more than 
one teacher during the school year. Table IX-12 shows the relation between 
coordination of instruction and student achievement. 



Table IX-12 

Correlation of Coordination of Instruction with Student Achievement 



Fall 
Achievement 

School- Grade- 
vide vide 



Grade 2 
Beading 
Math 

Grade 5 
Heading 
Math 



.25 
.32 



.30 
.38 



.11 
.48 



.35 
.37 



Spring ' 
Achievement 

School- Grade- 
vide vide 



.39 
.33 



.33 
.44 



.42 
.60 



.46 
.45 



Gain 

School- Grade- 
vide wide 



.26 
.10 



.16 
.16 



.50 
.51 



.32 
.25 



N for schools is 55; for grades, N varies from 40 to 47. 
Source: Report 16, Tables 6-5 and 6-6. 



It should be noted that higher coordination of instruction is associated with 
higher fall achievement scores, which indicates that there is more coordina- 
tion, of "instruction in the higher achieving and more economically advantaged 
schools. Also there is a positive relationship of coordination of instruction 
and achievement gain.. Since there are these positive relationships, they 
should be associated with various instructional practices and components of 
opportunity-to-leam. However, the relationships between coordination of 
instruction and on-task behavior were small and of mixed, sign, with test- 
curriculum overlap they were also not signif icant, but they were positive 
with amount of time in instruction. Perhaps' where teachers coordinated 
instruction, they are aisle to devote their time more effectively to instruc- 
tion. This is, supported by a negative .correlation of about .30 between the 
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amount of time spent in behavioral management and coordination of instruction. 
iU,so there were significant positive correlations between coordination of 
instruction and the flexible use of specialists, and also with the variety of 
equipment use in instruction. As might be expected from the previous section, 
there were correlations in the neighborhood of .57 between teacher satisfaction 
and coordination of instruction. Generally, coordination of instruction is 
related to a number of important instructional processes and staff character- 
istics. 



Instructional Leadership 

The principal has as one of his responsibilities the leadership of instruction; 
but it is only one of his many responsibilities, which include the providing 
cf resources, the obtaining of staff, the coordination of instruction, and 
interacting with parents. We particularly studied the principal's role in 
instructional leadership. Previous studies have stressed the importance of 
this factor' and we isolated it from the other parts of the duties of the prin- 
cipal. V/e defined instructional leadership in terns of four behaviors: the 
degree to which the ' principal was involved in deciding on curriculum, whether 
the principal had a particular view of instruction he felt strongly about, the 
ex-tent to which the principal communicated to teachers about instruction, ^and 
the degree to which the principal influenced teachers 1 instruction. We 
developed a measure of instructional leadership based on interviews with the 
principal and the teachers. 4 0n a scale from 1 to 5, the average amount of. 
instructional leadership was about 2.4, which does not indicate a' high amount. 
When we investigated the relationship betveen instructional leadership and 
student achievement, there was a negative relationship which varied from -.03 
to -.33 for fall and spring scores and insignificant and mixed signs for gain 
scores. This indicates that the principals exerted stronger instructional • 
leadership in the schools with lower achieving students, but thac such leader- • 
ship did not affect, the amount students iearned* M*e also investigated the 
relationship of instructional leadership to test-curriculum overlap, to time 
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In instruction, and to on-task behavior- The correlations were small and so 
variable as to ba uninterpre table. Other factors were investigated and it 
was found that the flexible use of specialists and the amount of their experi- 



This pattern .emphasizes the idea that principals who are assigned to low 

achieving schools exert more instructional leadership and use their resources 

more flexibly with low achieving students. But since low achieving student*; 

show smaller gains than high achieving students, the effects of instructional 

leadership are masked by the nature of the schools to which the principals are 

assigned. However, to the extent that the principals and the teachers share 

a common view about the nature of the reading and math programs and how they 

should t be taught, there is a positive correlation, in. the order of ,16, 

between achievement gain and this commonly shared view. After all, teachers 

do the instruction and the principal can only influence instruction through 
> 

them. 

THE FINAL EDUCATIONAL PROCESS MODEL 

At the beginning of this chapter we presented a rational model 'of the educa- 
tional process. Each of the subsequent sections dealt with one of the factors 
making up the model. Generally each of the factors was made up of a number 
of subfactors that we observed and measured in the fifty-five high-poverty 
schools* We also discussed the interrelations among the factors, and parti- 
cularly the relation of the opportunity-to-leam factor and the spring achieve- 
ment, factor. Now that we have examined all of these, factors and their inter- 
relationships, we are in a position to see if our proposed model actually fits 
the facts as obtained from the observations. The technical process for doing 
this is complex and is known as "causal modeling. 1 * This technique has* been 
developed in recent years by Jc5reskog and his associates and has recently 
been reviewed by Bentler (3) . 



ence were positively correlated with principals' instructional leadership. 
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The model was tasted at the level of the instructional unit, that is the unit 
composed of the same students with the same instructional staff working on 
the same instructional curriculum. Wo selected as 1 indioators those measures 
that seemed most promising in light of the results of the analyses reported 
in the previous sections of this chapter. Opportunity-to-learn was represen- 
ted by measures of each of its three components: instructional time, curricu- 
lum overlap, and student on- task behavior. The instructional practices 
included in the model were the proportion of the teacher's time spent in 
behavioral management, the proportion of time spent off-task, and the propor- 
tion of time spent in instruction. Resource use was confined to measures of 
the variety of equipment used, the hours of equipment use, and the hours of 
material use. The staff f characteristics entering in the model were recent . 
teacher training, teacher's job satisfaction, and teacher's years of experience 
at the current school. Both gradewide and schoolwide measures of coordination 
of instruction were included in the model. Principal's instructional leader- 
ship was represented by a measure of the principal's influence in the 
decisions regarding curriculum. The other factors were represented by- single 
scores, as mentioned in the sections' discussing them. 

When the path coefficients were determined, it was apparent that the rational 
model was too simple to fit the data. That is to say that while the general 
nature of the model was consistent with the observed facts, there were more 
interacting components than had been anticipated. Figure IX- 2 shows .the 
model that was derived by comparing the several models fitted by grade and 
by subject matter (for reading and math in both grades 2 and 5) . The paths 
shown are those that were significant in at least two of the four data sets 
and not of an opposite sign in any. Thus the model represents the "best" 
overall model from our data. 
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Source: Report 16, Figure 9-2. 

Figure IX-2 ^ 
The Final Educational Process Model 

'Inspection of the final model shows it to be much more complex than we had 

anticipated. This finding reinforces our conclusions that the educational 

process is an exceedingly complex activity. Important changes from the 
rational model to the final model are: 

•> The final model has many more non-2ero causal links than were included 

in the rational model. Important among these are direct links to 

spring achievement from instructional practices, coordination of 

* 

instruction, and economic status. 
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• Economic status appears to have a widaupraAd in if Inane a on var.Ub.laA 
which Inalude, in Addition to fall achievement, spring achievement, 
coordination of instruction, and ataff characteristics, 

a The influence of principal's instructional leadership ia Loss wide- 
' spread than indicated in the rational model. Specifically, evidence 
for a causal link from principal's instructional leadership to 
coordination of instruction was not found; also not supported was the 
causal link to staff characteristics. 

In addition to the analyses reported here, Report 16 included a discussion 
of analyses based on school level data. Generally these results are consistent 
with those already presented. Based on the results from the various models we 
can conclude that spring acuievement, the component in our research that is 
the ultimate payoff of the educational process, is in direct causal relation- 
ship with the following: 

The amount of student on-task behavior 

The degree to which the content of the curriculum corresponds to the 
spring achievement test 

The extent of coordination of instruction 
The'level of socioeconomic status 
Fall achievement. 

Indirect causal contributors to spring achievement are: 

Proportion of teacher's time spent in instruction, an increase in which 
leads to increased on-task behavior. 

Proportion of teacher's time spent, in behavioral management, a decrease 
in which leads to increased on-ta.sk behavior. 
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Teachers' experience, mora atf whlah laada to Increased curriculum overUp 
and indirectly to inareaaad on-taak behavior, mediated by decreased time 
spent in behavioral management, Mao, mora teacher experience leadti to 
incrftaued teacher satisf action which leads to increased coordination oC 
instruction. 

Fall achievement Level, higher levels* of! which increased curriculum overlap. 

Socioeconomic status, higher levels of which lead to increased coordination 
of instruction and increased fall achievement. 

In summary, we now have a model of the educational process that is supported 
by a sizable amount of data collected from actual observations in schools 
and classrooms. The educational process is complex, but one that we are 
understanding better. We now know which factors of the educational process are 
important to student achievement and thus we can infer which ones we should 
attempt to improve. 
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CHAPTER X„ WHAT THE HOMR hlMVIROMMWIT OP ELEMENTARY SCHOOL CH-EUIRENV 

This chapter examined tha home environment of elementary school children* 
The results show that: 

0 The usual home of an alimentary school ohitd is a two^adult 
family home, with parents about 25 years old} they are white, 
living in a single- family duelling and have graduated from 
high-school. Bat there are from SO to 35 percent who coma from 
homes with quite different anaraatez+Csiios . 

0 At home, the typioal student spends about two hours a day playing, 
an how doinSg chores, about two fiours watahing TV, an hour read- 
ing for pleasure, and an hour doing school homework. 

0 Most of the ohildren come from homes where the parents are 

involved in sohool related extra~cta*riaular activities and most 
parents attend parent~teaaher conferences. f 

0 Parents rate the quality of their children's schools as excellent 
or good in over 7S percent of the cases. 

0 Almost all parents expect their children to graduate from high 
school and over 25 percent expect them to graduate from college. 

0 The home environment of Title t students is quite similar to that 
of regular students. However* there is a slight tendency for 
more Title I students to come from homes with less well educated 
.parents, from minority homes , 'from homes with a somewhat less 
intellectual environment, and with somewhat lower expectations 
regarding school attainment. 

INTRODUCTION 

From what kinds of homes do America's school' children come? Data from the 
Participation Study throws light on this question. It will be remembered 
that ^about IS ,000 parents — the parents of a representative sample of the 
nation's elementary school students— were interviewed in the home. From these 
data we obtain the following, picture. The atypical student's home has parents 
who are about 35 years old, there are four or five members in the family 
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which is composed of two adults, living in a single-f amily dwelling; the 
parents ar& white, and are high school graduates. While this is the' typical 
picture, Table X-l shows that there is considerable variation from these 
typical figures. Ninety-five percent of the parents are between 25 and 55 
years of age, and about 30 percent of the families have three to six members. 
About 80 percent of the children come from two-adult families, but about 20 
percent of the families have only one adult. About 80 percent live in single 
family dwellings while 20 percent live in multiple-unit dwellings • About 75 
percent are white, non-Hispanic, while 25 percent of the families are minority 
families. About a third of the parents do not have a high school education, 
about a third are high school graduates, while a third have had some college, 
with 17 percent being college graduates. From the above it is clear that 
many children come from homes having somewhat similar background character- 
istics, but there ara also many children whose home backgrounds differ signif- 
icantly. 

HOME CHARACTERISTICS AND ACADEMIC ACHIEVEMENT 

How are these home characteristics 'related to the students' academic achieve- 
ment? Table X-2 shows the correlation between home characteristics and stu- 
dent achievement in reading and math. It will be seen that none of the rela- 
tionships are high, and they are generally in the expected direction- The 
highest relationship is between head of household's education and achievement. 
The relationship is higher for reading than fpr math and it is higher for 
regular students than for Title I students. . The smaller relationship for 
Title I students is partially accounted for by the more restricted range of 
the variables for Title I students. As would be expectad, those students who 
are members of the majority, live in single-f amily dwellings, have both 
parents in the home, and come from smaller families have higher achievement 
in both reading and math. While the relationships are in the expected direc- 
tion, they are typically small and allow for considerable influence from other 
factors, such as the impact of school* 



Table X-l 



Students 1 Home Characteristics 



Head of Household's 
Age (%) 

Family Size (%) 



One or Two Adult 
Family Home (%) 

Ethnic Status (%) 



Living Quarters (%) 



Head of Household's 
Education (5) 



8th Grade 9-11 High School Some College Post- 

or less grade Graduate College Graduate Graduate 



17-24 
1 



25-34 
37 

3 4 
11 30 



35-44 
43 

5 6 
26 15 



One Adult Family 
18 

Majority 
77 

Single Family Dwelling 
82 



15 



19 



32 



45-54 
15 

7 
8 



55-64 65 and over ! 
3 1 i 



8 
4 



9 
2 



10 or more 
2 



Two Adult Family 
82 

iMinority 1 

- 23 



Multiple-Unit Dwelling 
18 



-1-8" 



"8 



Source: Report 4, Table 2-2 



Table X-2 

Relation of Household Characteristics and Achievement: 





Reading 




Math 




Regul ax- 


Title I , 


Regular 


Title I 




Students * 


Students 


Students 


Students 


Head of Household's Age 


.05 


-.06 


.05 


-!oi 


Family Size 


-.11 


-.09 


-.04 


-.05 


One or Two Adults in Home 


.16 


.07 


.15 


.11 


Ethnic Status 


-.25 


-.13 


-.23 


. -.18 


Single or Multiple 


-.15 * 


-.11 


-.14 


-.08 


Dwellings 








» 


Head of Household's 


.35 


.16 


.29 


.11 


Education 











Source: Report 4, Table 2-5. 



STUDENT HOME ACTIVITIES " m 

While the factors discussed so far are related to achievement, they «.ire 
static/ demographic factors and the real impact of home environment is expres 
sed through actual activities in the home such as the attitudes of the parent 
toward the importance of schooling, how the students spend their free time, 
and the school-related assistance they get at home. What do the students do 
at home? Table X-3 shows the amount of time spent by regular and Title I 
students in a number of activities such as time spent playing, doing chores, 
watching TV, reading, and doing homework. 

Since the total amount of time available is fixed, if a child spends a great 
deal of time on one activity the child must spend less time on other activi- 
ties. As a general picture, during the day the "typical" child spends about 
two hours playing, about an hour doing cKbres, about* two hours watching TV , 
about an hour reading, and about an hour on homework- These are the amounts 
of time spent as reported -by their parents. When comparing the time spent by 
regular students with the amount spent by Title I- students one is impressed b 
the similarity of the figures. There may be a slight tendency for Title I 
students to spend nfore time on homework, on watching TV, and playing, while 
spending less time on reading. But the differences are very small and do not 
support the idea that, relative to regular students, poorer performing- stu- 
dents engage in significantly less academically oriented activities at home. 
This picture. is further supported by Table X-4 which compares the homework 
activities of regular and Title I students as reported by their parents. 
Again the figures are quite similar, but with some small differences. Title 
I students bring home a little more homework, and they get a little more 
assistance than regular students. There seems to be a. tendency for the Title 
I students to be helped by family members other than the parents more fre- 
quently than regular students. These other family members were identified as 
older brothers or sisters. 





Table X-3 

Time Spent 'on Various Home Activities 
(Daily) 





Regular Students 




Title I Students 


Tine Spent Doing Homework 


% 






No Time 


18 




16 


Less them 1 hour 


36 




31 


1 hour or more 


45 




53 


Time Spent Reading 








Less than 1/2 hour 


17 




'25 


1/2 to 1 hour 


34 




32 


1 hour or more 


• 48 


0 


42 


Time Spent Watching TV 








Less than lh hours 


17 




IS 


l*i to 2*i hours 


40 




35 


2*i hours or more 


43 




47 


Time Spent Doing Chores 






• 


No Time 


14 




20 


Less than 1/2 hour 


24 




18 


1/2 to l*i hours 


59 




53 


More than l*i hours 


6 




10 


Time Spent Playing 








Less them 1 hour 


10 




• 10 


1 to 2 hours 


34 




29 


2 to 2*i hours 


32 




34 


2*i hours or more 


24 




27 



Source: Report 4, Table 2-12, 
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Table X-4 
Student Homework Activities 



Frequency of Child Bringing 
Home Schoolwork 

Never 

Once a Month . 
Once a Week 
2 or 3 Times a Week 
Every Day ' 

Frequency of Child Getting 
Help on Schoolwork 

No Schoolwork brought Home 
Never 

Not Very Often 
Somewhat 'Often 
Very Often 

Who Helps Child? 

Mother 
Father 
Others 
No one 

Source: Report 4, Table 4-7. 



Regular Students 



9 
22 
13 
26 
30 



6 
6 
29 
28 
32 



60 
IT 
16 
7 



Title I Students 
% 



9 
18 
12 
26 
35 



6 
5 
21 
28 
40 



45 
9 
36 
10 



ERIC 
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It has often beerv suggested that poor children, predominantly Title I chil- 
dren, do not have the- educational opportunity in the home that regular' chil- 
dren have. It is thought that there are no magazines or books in many poor 
homes. Table X-5 shows the number of books appropriate for a child in the 
home for both regular students and Title I students. It will be seen that 
the vast majority of all students have appropriate books at home that they 
can read, but it seems that more Title I students have no books, and those 
who do have books have fewer than regular students- This is consistent with 
the picture that is emerging of the Title I students as having a home environ 
ment that is not greatly dissimilar to that of the regular students, but still 
one that is somewhat less oriented to intellectual activities. 



Table X-5 
Books in Home 



Number. of Books in 
Home Child can Read 


' Percent Regular 
Students 


Percent Title I 
Students 


None 


5 


13 


1-10 


19 


33 


11-30 


28 


26 


31-50 


16 . 


11 


51 or over 


32 


12 


Source: Report 4, Table 4-10; 







In addition. to strictly home activities the child is influenced by the 
parents 1 attitude toward the student's school and their participation in 
school activities. Table X-6 shows the participation of parents and students 
in school related non-instructional activities. It will be seen that the- 



Table X-6 

Participation in Extra- Instructional Activities 



-> 


Percent Regular 
Students 


Percent Title I 
Students 


Percent of Families where 
Adult Member Participates 

Activities 


80 


71 


Percent of ^Families where 
Child Participates in Extra- 
Instructional Activities . 


61 - 


59 


Percent of Families where 
Child Participates and Adult 
Attends Extra-Instructional 
Activites. 


60 


• 53 


Source: . Report 4, Table 4-3. 







majority of both parents and students participate in extra curricular activ- 
ities. Again the picture emerges of not dissimilar activities for regular 
students and Title I students , although the Title I students and their 
parents seem to be slightly less involved than regular students and their 
parentis. Another indication .of parents* involvement with the school is the 
frequency of parent-teacher conferences. Table X-7 shows a number of facts 
regarding these meetings. First it will be noted that there are no important 
differences in the frequency or 'nature of such conferences between regular 
and Title I students. About 70 percent of the parents have- such confer- 
ences and about a third have more than one meeting .annually. These confer- 
ences are almost always initiated by either the school principal or teacher* 
About .20' percent are related to student problems at school, but most of them 
are called for general discussions of student progress. Parents report the 
conferences to be helpful. 



Table X-7 
- • parent-Teacher Conferences 



Annual Number of Parent-. 
Teacher Conferences' 


Percent Regular 
Students 


Percent' Title I 
Students 


0 


27 


32 


1 


45 


35 


2 


16 


17 


3 


6 


9 


4 or more 


6 


8 


How Conferences Are 
Initiated 






Note sent home 


75 


74 


Teacher or Principal calls 


5 


6 


Sign up at Meeting 


4 


3 


Parent asks for Meeting 


13 ' 


16 


Other 


2 


2 


Reason for a Personal 
Conference 






Discuss Child's Progress 


58 


57 


Discuss Child's Problems 


17 


21 


Discuss Grades and/or 
Test Scores - 


7 


7 


Generally Exchange 


16 


12 


Other 


2 


3 


Are Personal Conferences 
.Heloful? 






Yes 


93 


95 


No 


7 


5 


Source: Report 4, Table' 4-2. 
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SCHOOL QUALITY AND PARENTS 1 EXPECTATIONS 

Parents were asked to rate the quality of their child's school. Table X-8 
shows the results. It is impressive that over 75 percent of all parents rate 
the school's quality as excellent or good. Title I students' parents rate 
the schools almost as high as regular students' parents. These ratings are 
in marked contrast to the stereotype expressed by some of the media and some 
political sources. One hears schools characterized as "disasters," "incom- 
petent," "incredibly poor," etc. At least in the minds of parents these 
stereotypes are far from accurate. It will also be remembered from Chapter V 
that all groups of students increase the level of their academic performance 
from year to year. -No doubt schools could be improved and students could 
learn more, but parents give schools a positive report card. 



Table X-8 

Parent's Rating of Quality of Child's School 





Percent Regular 
Students 


Percent Title I 
Students 


Excellent 


. 34 


25 


Good 




53 


Fair 


12 ' 


19 


Poor 


2 


3 


Source: Report 4, Table 4-13. 







A final indication of parents' attitude toward the academic process is given 
by their expectations regarding how much education their children will achieve. 
Table X-9 shows the highest educational level parents expect for their chil- 
dren. 
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Table X-9 

Parent's Expectation for Child's Educational Attainments 



Parent's Expectation of Level 
0>f Child's Final Schooling 



Less than High School 
High School Graduates 
Some College 
College Graduate 
<,nst Graduate 

Source;- Report 4, Table 4-11, 



Practically all parents, of both regular and Title I students, expect their 
child to graduate from high school. Title I parents have a somewhat lower 
academic aspiration for their children than the parents of regular students 
Almost 45 percent of the parents of regular students expect their child to 
graduate from college but only about 25 percent of Title I parents do. 



Percent Regular 
Student s 



1 
38 
16 
39 

6 



Percent Title I 
Students 



4 
53 
14 
21 ■ 
2 



In summarizing this material we see that the typical home of an elementary 
school child is a two-adult family home, with the parents about 35 years old, 
they are white, living in a single family dwelling and have graduated from . 
high school. But there are 20 to 25 percent of the students who come from 
single-adult family homes, with younger (or older) parents, who are black or 
from an Hispanic background, living in multiple dwelling homes and whose 
oarents did not graduate from high school. Although the relationships are 
not strong, there is a tendency for students to do better academically who 
come from the two-adult families, of smaller size, who are white, living in 
a single family dwelling, whose parents are better educated. These relation- 
shins are stronger for regular students than they are for Title I students. 
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' At home, the typical student sp.ends about two hours a day playing, an hour 
doing chores, about two hours watching TV, an hour reading for pleasure, and 
an hour on homework. Most students bring homework home, but about 25 percent 
either never do, or do so only once a month, when the students bring homework 
home they usually receive help with it from their mother or from older chil- 
dren. Most children have books in the home they can read for pleasure, 
although about 10 percent have no such books. 

Most of the children come from homes where the parents are involved .in school 
related extra-curricular activities and most of the students are involved in 
such activities. The vast majority of < parents attend parent-teacher confer- 
ences which are initiated by the school. Most of these meetings are for a 
general review of student progress, although about 20 percent are called 
because of student problems. . , 

Parents rate the quality of their students' schools as excellent or good over 
75 percent of the tiite. Very few characterize then* as poor, a finding in 
marked contrast to the image often reflected by the media and some politi- 
cians. Generally parents expect their children to graduate from high school 
and over 2S percent expect them to graduate from college. 

When Title I students are compared with regular students one is impressed- with . 
the fact that Title I students' home environments are quite similar to regular 
students on the above characteristics. There is,' however, a tendency for more 
of the Title I students to come from homes^of less well educated, paretns , from 
minority homes, from homes with a some what "less intellectual atmosphere, and 
with somewhat lower expectations regarding school attainment, while the dif- 
ferences are not Large, they may be quite influential and we will see in the 
next section how much influence they have on differences in student perfor- 
mance. 
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CHAPTER XI. WHAT ARE THE CONTRIBUTIONS OF BACKGROUND 
AND SCHOOLING i TO STUDENT ACADEMIC ACHIEVEMENT? 



Su m m ar y 

■ | 

The data from the Sustaining Effects Study were analyzed to throw light 
on the controversy that Triad existed regarding the relative importance of 
background factors and schooling factors in accounting for educational • 
achievement. Data at the] individual szudent level were available regard- 
ing home background, economic status , the characteristics of the school 
attended, and achievement over a three year period. Three different 
composites were formed: 'Student Background, School Characteristics, and 
School Learning Experience. The relationship between these and student 
achievement was explored] using the techniques of causal analysis. It 
was found that while background characteristics were important determiners 
of achievement, the schdol learning experiences were also important, 
particularly in the early grades. 

INTRODUCTION 

The Sustaining Effects Study was designed primarily to study compensatory 
education and the process of elementary education. However, in collecting 
data to study these areas we also obtained information that shouXST throw 
flight on the controversy that has surrounded the question of equality of 
educational opportunity. As is well known, the Coleman report, titled 
Equdlity of Educational Opportunity, concluded that "schools bring little 
influence to bear on a child's achievement that is independent of his back- 
ground and general social context," (4). This conclusion has been much 
debated aftd it is generally agreed that the data available were not ideal for 
establishing this conclusion- Data from the Sustaining Effects Study are 
superior to those previously available because we have quite good home back- 
ground and economic data for individual students (see Chapter IV) , and we also 
have achievement data /for each' student for three successive years . (Mo 
individual student data were available in the Coleman study.) In addition, 
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we have quite' detailed data on each school attended by the students. Since 
these data were available we undertook an analysis of the relative contribu- 
tion of the students 1 background, of the schools attended, and of the instruc- 
tion received as they affect student achievement:- 

Report 20 is devoted to a discussion of . the- strengths and weaknesses of 
previous studies, and to the analysis of these new data.. In this chapter we 
simply report the way our analysis was done and give' the major results. Those 
more deeply, concerned with this complex subject will want to examine Report 20 
in detail, Th$ general nature of the analysis was to develop a theoretical 
model of .the direct* and indirect influences of socio-economic background, 
characteristics of the school attended, and educational experiences, as they 
influenced students' achievements on tests- of reading and math. The analysis, 
depended on the technique known' as "causal modeling" mentioned previously in 
Chapter IX. The analysis used' data collected in the "Participation Study,-" 
which involved the selection of a nationally representative sample of elementa. 
school -students and the conducting of home interviews' with their parents.. (Se- 
Chapter rv for a more detailed description of the sample and the data collec- 
ted.) Although the Participation Study initially involved 15,579 students, by 
the end of three years there were only 2,966 students remaining on .which, there 
were complete data. An analysis of this 'attrition shows that the greatest . 
losses" were sustained by the least advantaged socio-economically , but' it is. 
still believed that the sample* is sufficiently representative to allow genera, 
alizable conclusions • to be drawn. t 

Three different composite variables were formed: one for socio-economic back- 
ground, called the Background Composite (B) ; one for the .Characteristics o| : 
the School (S) ; and one for the School Educational Experiences (X) . Each 
composite was formed by regressing lacer achievement on earlier achievement, 
'cohort, and a set of variables that were thought to represent the factor 
making up the component. This method of forming the composites means that : 
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the variables selected to make up the components were those most important in 
accounting for the achievement gain from the fall 1976 to the spring 1979. 

THE BACKGROUND COMPONENT 

By means of this regression analysis, eight variables were selected from a 
set of twelve to define the Background Component (B) . These variables .were : 

1. Father's education (.40) 

2. Mother's education (.40) 

3. Occupation of the household head (.30) 

4. Family income (.37) 

5. Race/ethnicity (.38) 

6. Number of parents in the home (.20) 

7. Number of books in the home at the child's reading level (.47) 

8. Parent's attendance at school events (.26)- 

S^iown after each of the variables is the correlation of that variable wich the 
Fall 1976 achievement measure. It is interesting to note that the highest 
correlation is between achievement and number of books in the home at the 
child's reading level, which implies that background is more than just socio- 
economic status, but rather the intellectual emphasis typically found in homes 
of higher socioeconomic status. 

It should be noted that these correlations reflect how much the factors 
influence the achievement level of the students when they entered the study 
and for cohort 1 they reflect the student's achievement level on entering the 
first grade. Thus, the Background Composite measures the abilities the stu- 
dent brings to school based on several factors: native ability, the motivation 
given by parents and other non-school experiences, the influence of education 
related factors in the home such as the presence of books, and also the * 
influence of preschool peers and their attitude toward learning. 
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THE SCHOOL CHARACTERISTICS COMPONENT 

In addition to a student's background, the characteristics of the school 
attended affect the student's learning. These characteristics can be defined 
in a number of ways and include such factors as the affluence of the neighbor- 
hood surrounding the school, the school's physical facilities, the char- 
acteristics of the student body, and the characteristics of the staff. Again 
the regression technique was employed to select the variables to make up the 
School Characteristics (S) composite. The variables defining the composite 



were 



1- The 'racial/ethnic composition of the student's grade at the school 
(.34) 

2. The average academic achievement of the grade at the school in the 

fall of 1976 (.52) 
3- The educational attainment of the school's principal (-.11) . 

4. The level of compensation given teachers for inservice training (.00) 

5. The presence of a central library at the school (-.02) 

There were fifteen other school characteristics included in the regression 
analysis but they would not have- improved' the prediction of achievement. These 
other variables included per-pupil expenditures, the presence of reading and/or 
math resource centers, relative size of staff, receipt of CE funds, hours of 
instruction in the school, teaching experience of the staff, etc. . Again the 
correlations between the variables and fall 1976 achievement scores are given 
in parentheses. 

It will be seen that the two largest correlations ars for the average achieve- 
ment level' in the school and grade, and the racial/ethnic composition of the 
school and grade. These two correlations are between the individual student's 
fall achievement scores and the school-by-grade average attainment and racial 
composition. Thus, the School Characteristics (S) composite is almost com- 
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pletely defined in terms of the characteristics of the students attending the 
school- The correlation of factors making up the School Characteristics 
Composite, such as the average school achievement level, with the factors • 
making up the Background Composite is quite high. For example, the correla- 
tions between average school achievement and race/ethnicity in the Background 
Composite is .51/ with family income it is 146, and with father's education 
it is -40. Thus, in many ways the School Characteristics Composite is simply 
a reflection of the background of the students attending the school - 
Peer characteristics are a good predictor of a student's achievement largely 
because these characteristics are highly related to the student's background. 

THE SCHOOL LEARNING EXPERIENCES COMPONENT 

In accounting for a student's achievement/ we have pointed to the native intel- 
ligence, to socioeconomic background, and to the characteristics of the school 
attended. In addition there are the actual School Learning Experiences (X) 
that take place in the classroom. Again a number of .variables were explored 
to make up the School Learning Experience (X) composite. The significant 
variables were: 

1. The average academic achievement of the student's homeroom (-51) 

2. The racial/ethnic composition of the student's homeroom (.34) 

3. The average teaching experience of the teachers (.11) 

4. Whether or not the student received compensatory education services 
(-.35) 

5. The weeks of student 1 s attendance at school (-16) 

6. The number of hours of regular instruction in reading received by 
the student during the school year (..11) 

1. The number of hours of regular math instruction received by the 
student during the school year (.07) 
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8. The number of hours of special reading instruction received during 
the school year (-.22) 

9. The number of hours of special math instruction received during the 
school year (-.15) 

The correlations given after each variable are between that variable and the 
student's spring 1977 achievement score. 

We see that the characteristics of the student's homeroom, which are a.lso 
related to the student's background, are closely related to the student's 
individual achievement. Variables related more directly to instruction such 
as hours of instruction and receipt of compensatory education are related to 
the student's achievement, but to a smaller degree than many of the group 
membership characteristics.' Incidentally, it should not be surprising that 
the receipt of compensatory education and the amount of special instruction 
axe negatively related to achievement, since these instructional activities 
axe the ones most intensively received by the lowest achieving students. 

THE RELATIONSHIP OF THE COMPONENTS TO ACHIEVEMENT . 

We have shown how the three components were formed and we have shown the 
relationship between the variables and measures of achievement. But we have 
net yet emphasized the idea that these composites have both direct and 
indirect effects on how much the student learns. For example, the number of 
books in the home that the student can read, directly affects the achievement 
shown by the student when he enters school. . But this variable also .indirect! 
affects the student's motivation. Since the parents have provided these 
materials they have given motivation for the student to read well in school, • 
and because the student initially does well in school, he receives additional 
rewards that motivate him to. continue superior achievement. All of the com- 
posites and their variables are interrelated in ccmplex ways and also have 
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direct and indirect effects on later achievement. In an effort to understand 
how these factors influence the acquisition .of reading and math achievement, 
we developed a model of the background and schooling process and analyzed the 
relationships involved, using the methods of causal analysis. These analyses 
were done for each cohort since the relationships for students just entering 
school might well be different from those for students in the more advanced 
grades. We should remember that students in cohort 1 start in the first grade 
and are followed through the third grade, and similarly with each cohort so 
that cohort 4 starts in the fourth grade and goes through the sixth grade. 
With cohort 1 we have students who are just entering school and the influence 
of background and school characteristics might well be different tha.fi or 
students from cohort 4 who started the study with three years of school 
experience before we had amy achievement measures on them. Figui% XI-1 shows 
the results of the analysis for each of the four cohorts. In -he figure, '3' 
stands for the Background Composite, 'S 1 for the School Characteristics Com- 
posite, 'X' for the learning Experience Composite, *A ' stanl^ for che achieve 
ment level at the beginning of the srady, and ' A^ 9 stands for the achievement; 
level three years late:?. . The rtisulfts are based on academic growth from the 
beginning of the first year to the end of the third year. Similar analyses 
were performed on ya'ar-by-yea data, that is year 1 to year 2 and yea;v 2 to 
year 3. , The results were substantially similar to those reported here and are 
given in Report 20. 

We will examine the relations )?JLps starting with the composites on the left 
hand side of the model since these are the most removed from the level of 
achievement at the end of three years. First note that Background is related 
to Initial Achievement (A Q ) with coefficients between .49 and .58. From 
cohort to cohort these coefficients are fairly sjuiiiar in size and do not 
show' any systematic variation. They do indicate a fairly strong relationship 
between the student ,; -2 background and his initial level of achievement. Next 
note that the relationships between Background and School Characteristics are 
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Cohort 1 




Colwt 2 




Cohort 3 




Colidrt 4 




Pitjure 

Path Diagrams With Estimates of Standardized Coefficients. 
(With Nonsignificant Effects Omitted) 



o Source; Report 20, Figure 3-2. 



between .21 and .32 and again without any particular pattern.. They are smaller 
than those between Background and Initial Achievement, but show a tendency for 
students from backgrounds with greater resources to attend schools having more ■ 
resources. The relationship between School Characteristics and Initial Achieve- 
ment (A Q ) range from .10 to .27. These are generally of the same magnitude as 
those between Background and School .Characteristics , indicating that students 
attending schools having more resources tend to have higher initial achieve- 
ment. Both the background of the student and the characteristics of the 
schools they attend are significantly related to their initial achievement. 

Next we will examine the relation of these background related factors to the 
School Learning Experience (X) . The path from Background f \o School Learning 
Experience has practically no variation across cohorts and is about .28/ show- 
ing that students with a background with more resources tend to have better 
school learning experiences, but the magnitudes of the path coefficients are 
only modest. The coefficients from School Characteristics to School Learning 
Experiences range from .07 to .23, with the average being about .17; this 
finding suggests that schools with superior characteristics tend to have good 
learning experiences for their students, but the relationship is quite modest 
in strength. The path coefficients from Initial Achievement to School Learn- 
ing Experiences are considerably larger than the previous ones, ranging from 
.41 to .48. This shows that those students who have high initial achievement 
levels are in school learning* situations that are also quite favorable. 
Finally the relationship between Initial Achievement and achievement at the 
end of three years is high for all cohorts, starting with .44' for cohort 1, 
increasing to .64 for cohort 2, being .65 for cohort 3, and growing up to .72 
for cohort 4. These high relationships are important since they show that .the 
highest relationship to year three achievement is the achievement at which the 
child entered the school for cohort 1 or enters the study for other cohorts. 
But also' note that the strength of the relationship grows from cohort to 
cohort; this says that as the student progresses through school his level of 
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performance becomes progressively more related to his previous level of 
performance. The fact that it is the lowest for cohort 1 says that there is 
a greater possibility of influencing futipre achievement in the first and 
second grades. Also note that the paths from Background to Pinal Achieve- 
ment are quite weak, ranging from .08 to -14. This indicates that Background 
has relatively little direct influence on final achievement but rather that 
its influence is indirect, through Initial Achievement, School Characteristics, 
and -the School teaming Experiences. 

Finally note the path coefficients between School Learning Experiences and 
Final Achievement, which are .35 for cohort 1, .06 for cohort 2 (somewhat 
low, but complemented by the significant direct coefficient between School 
Characteristics and Final Achievement unique to this cohort), .18 for cohort: 3, 
and .06 for cohort 4. These figures are very important. They imply that in 
the beginning grades, school learning experiences are quite effective, almost 
as effective as Initial Achievement and perhaps as important as Background. 
But as grade progresses/ the influence of School Learning Experiences decreases 
until by the fourth, fifth, and sixth grades School Learning Experiences seem, 
to exert very little influence on Final Achievement. At the same time Back- 
ground is only very modestly related to final achievement in any direct, way, 
although it still exerts a considerable influence indirectly through its 
relationship to Initial Achievement. It will be remembered from Chapter. V 
that the strongest influence of compensatory reading education was also seen 
in the beginning grades . These two lines of evidence strongly suggest that . 
the time to influence students' achievemenc is early in their school 
experiences. 

It should be mentioned that a similar model was developed in which the 
achievement variables were analyzed as two components, one for reading and 
one for math. The results were quite similar to those already presented 
except that for math the Background factor was not quits as strong as it was 
for reading, and the influence of School Learning Experience. was stronger for 
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math than for reading. Again we 3ee that reading is influenced by factors 
that occur outside the school to a much greater extent that is the case for 
math. As we would expect, academic subjects that are learned more formally 
are more uniquely learned in school, whereas those of a more general nature 
may frequently be learned in other than the school context, particularly b^ 
students from advantaged backgrounds. These results are quite compatible 
with the recent findings of Welch, Anderson, and Harris (37) who found a 
quit9 significant schooling effect for high school math. 

The data presented are relevant to Coleman's conclusions about the importance 
of students 1 background and the unimportance of school experiences. The 
present data certainly confirm the importance of background characteristics 
but leave unanswered the question of what proportion of background is rela- 
ted to influenceable home factors and how much is simple native intelligence. 
Our opinion is that both factors are involved and that with proper support 
the home factors could be improved for students coming from disadvantaged homes. 
This would involve making reading materials available in the home and getting 
parents to see that the- child used them. It would also involve motivating 
the parents to value intellectual experiences. In addition, the data show, 
contrary to Coleman's results, that in the early school years the character- 
istics of the School Learning Experiences is of considerable importance. 
These findings would seem to place emphasis on the importance of positive 
learning experiences in the early grades and give support to efforts to 
improve school experiences in the beginning grades. 

It is worthwhile to speculate that early childhood experiences are very impor- 
tant in determining a child's later academic performance. If at a young age 
the child has parents who provide early opportunities for experience with 
books, who motivate the child to excel in verbal areas, and who give him 
early preschool experiences, it seems that initial achievement will bis high. 
If initial achievement is-high, then the child has the best chances of con- 
tinuing to experience successful academic achievement. It would seem that 
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whatever can be done to bring about thuse favorable early childhood experiences 
should be done if we value good academic performance. Such measures would be 
particularly important in the homes of disadvantaged children, 
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